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Preface 


The  purpose  of  this  studj-  was  to  investigate  the  development  of  a  Walsh-domain  adap¬ 
tive  filter.  Discrete  Walsh-domain  signal  proce.ssing  provides  computational  and  hardware 
simplification  versus  discrete  fiequenc\ -domain  signal  processing  ie(|uirements.  Theiefore, 
development  of  a  Walsh-domain  adaptive  filter  would  provide  a  robust  self-designiirg  sig¬ 
nal  processor  suitable  for  applications  which  limit  available  power  and  space,  particuhirly 
sirace-based  signal  processing.  B}  e.xterrding  a  circular  convolutiorr  fre(|uency-domairr  adap¬ 
tive  filter  and  the  Fast  LM-S  frec|uerrcy-dorrrairr  adaptive  filter  into  the  Walsh-domaitr.  two 
Walsh-dorrrrain  adaptive  filters  were  developed. 

I  catr  not  fully  express  my  appreciation  of  the  invaluable  guidance  prov  ided  by  rrrv  thesis 
advisor,  Captain  Rob  Williarrrs.  His  helpful  suggestions  wer-e  not  rrrere  cookbook  solutions, 
they  pr-ovided  this  student  with  excitirrg  opportunities  for  discovery  and  iirsight.  1  would 
also  like  to  thank  those  on  the  thesis  conrnrittee;  Dr  Matthew  Kabrisky  arrd  Martin  Desimio. 

Abov('  all.  1  thank  rrr>  best  frieird  arrd  wife,  .Shannon.  .Any  acconrplislrirrents  that  I 
have  trrade  were  gained  bv  her  sacrifices. 


I^arry  .J.  Duvall 
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Abstract 

Two  W'albh-domaiii  dyadic  convolution  .‘•-'aptive  fdters  are  de\eIoped  using  a  ciicu- 
lar  convolution  frequency-domain  filter  (EDr.;  ■  the  Fast  LMS  adaptive  filter  (FDF2): 
VVDFl  and  VVDF2  respectively. 

General  theory  of  time-domain  adaptn--.  e. ;s  and  a  theoretical  anar  sis  of  the  FI.M’l . 
FDF2.  VVDFl.  ar.d  WDF2  filters  are  presentc  VVDFl  and  VVDF2  software  implementa¬ 
tions  are  shown  to  be  eiror  free.  .A  time-donia!  .ei  (TDI")  and  a  FDF.!  fieciuency-domain 
filter  (FDF)  are  implemented  for  co'-'''Darisoii  ,ig.  Tlu  WDFl.  VV’DI-2.  TDI-'.  and  FDF 

lilteis  aie  tested  using  time-shifted  sinu.soidal  <  nd  lectangnlar  noisy  and  noiseless  signa'.'.. 
VVDFl  and  \VDF2  aie  shown  to  eoinerp  *  fastes  and  produce  less  error  filteiing  discontiii 
uous  signals,  relative  to  the  TDF  and  FDF  performance.  VVDFl  and  \VDF2  are  sho  vn  to 
conveige  slower  and  jnoduce  more  eiror  filtering  continuous  signals,  relative  to  TDF  and 
FDF  iierformance.  WDFl  is  shown  to  perform  betu,  foi  noiseless  signals,  relative  to  \VDF2 
pe; foi malice.  \VDF2  is  shown  to  perform  better  for  iiois\  signals.  r(‘iati\eto  WDFl  peifoi- 
manc<'.  V\'DFl  and  WDF2  filteiing  petformance  was  shown  t(;  degiad"  with  iiicieasing  time 
shift.  .A  processing  speed  comparison  showed  \\'DF1  to  be  faster  than  the  TDF.  FDF.  and 
WD!'2  filters. 
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A  WALSH-DOMAIN  ADAPTIVE  FILTER 


/.  Introduction 


1.1  Back'-  >uvd 

Tlie  developmeiit  of  space- ba.^cd  (•daplive  signal  processors  is  an  .ctive  aica  of  reser.rch 
(hat  lias  immediate  military  potential.  In  de\ eloping  space- based  .syst  ins.  s\stcm  robustness 
is  a  desirable  cpialit).  .Adaptive  sxslems  e.xliibit  that  c|uaiity  [11].  Therefore,  ‘‘an  adaptive 
system  that  continually  seeks  the  optimum  within  an  allowed  class  of  possibilities,  using  an 
oideily  search  piocess.  would  gi  .e  supeiior  perfoimance  compared  with  a  system  of  fi.xed 
design  ’  [9:5].  Real-Mme signal  piuc(.7sing  requires  that  the  .search  process  be  conducted  using 
a  minimum  of  time,  which  is  wli\  foi  e.xample.  frequency-domain  adaptive  signal  processors 
arc  more  commonly  irsed  than  time-domain  processors.  Speed  in  this  case  is  costly  becau.se 
hardware  required  to  implement  the  Fast  Fourici  Transform  (FFT)  is  sophisticated  and 
expensive.  Using  othei  liaiisform  domains  could  possibly  afford  a  haidware  savings  and 
letain  or  surpass  the  |)roce.ssing  spec  v)f  lirquencv -domain  prorc^ssing.  '1  !iis  thesis  looks  at 
the  development  of  a  W’alsh-domain  adaptive  lilter. 

1.1.1  Tin  \\  aBh-Domain.  Signal  jnores.sing  ol  stochastic  signals  can  be  accom- 
idished  in  a  variety  oi  domains,  the  most  common  being  lime  and  frecjuency.  There  are 
basically  iwo  leasons  ioi  choosing  one  piocccssmg  domain  \ei.^us  another.  First,  a  computa¬ 
tional  adv  Ullage  ma.'  be  achiewed.  Fot  example,  the  sin.plicitv  achieved  in  |)eifoiming  the 
convolution  ^f  t wo  discietelv  sampled  data  .sets  with  the  Fast  Fouiiei  Tiansfoim  (FFT)  vei- 
sus  peifoiming  the*  coiuohition  sui.;  [idj.  I  ue  .second,  information  of  interest  ma>  be  more 
visible  in  one  doma'’i  than  anolhei  [10].  Frc'queiu  v  distiibution  i.'^  cleailv  indicated  in  the 
frequency  domain,  wlnle  ami)lilucle  characteiistics  are  clearlv  indicated  in  the  time-domain. 

W'alsh-domain  |)!Oc casing  concerns  the  reprccsentat  ion  of  a  signal  as  a  sum  of  we’gli  ed, 
bipolai-pulse  wavelorms.  In  the  W’alsh-domain.  continuous  and  di.screte  time  signals  aie 
rei)re.scntc'cl  in  terms  of  an  oithonormal  set  of  basis  function.s  consisting  of  vvavefoims  with 
discic’leil  amplil  uch' value"- [) .  1 7  IS].  Walsh  fnne  tioiis  fUe  defined  ovei  a  finite  time- inlcuval. 


which  is  usually  noinializecl  to  one,  and  by  an  ordering  numbci  n  [1:9-10]  which  specifies  the 
number  of  limes  the  function  passes  thru  zero  over  the  time  inter\al;  leferied  to  as  ^-ujutiuij 
(1:15). 

The  Discrete  Walsh  Transform  (DWT)  of  a  discretely  sampled  continuous  time  signal 
is  accomplished  generally  in  the  same  manner  as  the  Discrete  Foinier  'rranslorni  (DTT).  Th<' 
N-point  DWT  transform  ])air  [l:o0|  is  as  fo'lows: 


AT  =  l/A''^‘.T,ViMT(n.O  (1.1) 

1=0 

and 

x,=  f^Xn\VAi{n.,i)  (1.2) 

ri=0 

Figure  1.1  shows  the  N  —  8  series  Dis^^rdc  W  Vsh  functions.  The  DWT  spec  tial  components 
are  represented  by  the  AT  terms  and  n  i:  the  ordering  number.  The  data  se(|uence  is  indicated 
by  X,.  wheie  i  is  the  discrete  time  inde;.  and  A’  represents  the  number  of  data  \aiues  being 
transformed. 

The  hernel  of  the  DWT  sum.  \VAL{^i,i),  is  ±1  depend'ng  upon  the  values  of  u  and  i. 
Equations  1.1  and  1.2  show  that  the  DWT  produces  its  own.  inverse.  .Just  as  in  the  ca.se  ol 
the  DPT,  algorithms  exist  to  produce  a  fastei  transfoim;  the  Fa.sl  Walsh  IVansfoim  (FW  1  ) 
(.  .nSj. 

The  DWT  should  be  considered  for  time-limited  wav('fo.  n'.s.  because  ..il  is  possible 
for  the  puwei  spectium  to  be  .sequeiicy  limited  although  the  c ones|>onding  lime  lunctions  aie 
time  limited"  [1:103].  For  a  time-limited  waceforrn.  the  DWT  .sequency  spectra  has  a  finite 
number  of  tenns  while  the  DFT  would  generate  an  infinite  freciuenc\  spc'clra  [1:103]  such 
that,  in  gcnieral.  “a  continuenis  t_\|jeof  wavelc^rm  facouis  using  the  DM  and  .i  discontinuous 
t\  pe  of  waveform  favours  using  the  DWT"  (1:132). 

In  terms  of  an  im])lenic’ntation  compaiison  with  the  Df  1.  the  I)W 'I  is  much  simplei 
and  fa.^tei  becausethe  DW'J' tiansformation  mati  i,\  is  com|;o.se.l  of  leal  vahic's(±l)  whilethe 
DF'i  t ! ansfoi niatic)!!  matrix  is  composed  of  compic*x  valuers  [l  .')]].  \Iso.  the-  D^M’  rc'c|uirc's 
no  rnultiidication  opc.ations  because  the  transform  matrix  values  are  ±1.  thus  ic'ducing  the 
multiplivaiion  opeiations  to  simply  addition. 
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8.  in  sPC|uonc\'  order. 


Figure  1.2.  Adaptive  Filter 


LI. 2  .Adaptive  Filters.  The  adaptive  filter  is  a  signal  processor  that  possesses  self- 
adjusting  capability  and  is  time  varying  [3:2-1-!].  The  most  common  form  of  adaptive  filter 
uses  a  closed-loop  design  (See  Figure  1.2).  The  filter  processes  the  input  .r,  to  yield  an 
out|)ut  (/,  which  is  compared  against  a  desired  signal  d,,  yielding  an  erroi  signal  e,.  The 
desired  signal  d,  serves  as  a  '^raining  signal'  for  the  filter  [9:18].  Adaptive  filters  can  be 
implemented  as  time  domain  filters  or  as  transform-based  filters,  which  are  referred  to  as 
block  processing  adaptive  filters. 

1.1.2. 1  Tim( -Domain  .Adaptive  Filters.  The  single-input  time-domain  LM.S 
adapti\e  fillci  piute.s.soi  .-.tiucture  used  in  this  thesis  is  referied  to  as  an  .Adaptive  Transversal 
killer  (.VI  k  )  [9:IG].  .\s  show'ii  in  Figure  1.3.  the  .ATk  is  a  standard  Finite  Impulse  Response 
(FIR)  digital  filtei  stiuctuie  with  tap  weights  which  adapt  with  time  pci  a  |)redpfincd  adap¬ 
tation  algorithm.  In  this  figuie  ,  the  .-VFF  has  {L  -i-  1)  taps.  .Since  the  filtei  weights  arc 
adjusted  using  the  Widrow-Iloff  LMS  algorithm,  hj(i)  rcprc.sents  the  tap  value  of  the  jth 
weight  at  time  i  [!):  100]. 

1. 1.2.2  Block-Processing  .Adaptive  Filter.-i.  Since  the  DVVT  is  generated  in  a 
mannei  verv  similai  to  the  DFT,  frequency-domain  block-processing  filtei  theory  might 
piovide  insight  into  how  to  develop  a  Walsh-domain  block-proce.ssiiig  filter.  This  section 
looks  at  a  Frequency  domain  block- pi oce,ssing  filler  that  performs  circular  convolution. 


\-A 


a-,-/. 


I-'igure  1.3.  .Aclaplive  Transversal  Filler 


One  signifiranL  clilTerence  between  a  transform-based  adapti\e  filler  and  the  time 
domain  filters  is  that  the  data  is  procc.ssed  in  blocks  [2:14G]  (Figure  I.l).  The  constant 
.V  specifics  the  block  size.  The  .V  data  points  of  (I,  and  .r,  for  the  /.th  block  are  transformed 
using  the  Fast  Foiniei  Transfoini  (FFT).  The  transform  components  i>f  the  ^th  input  block. 
X„(l,  ).  arc  then  multi]  lied  with  the  respective  freciuency-domain  filtei  weights.  H„{h).  f<n- 
the  ^th  block  to  prodi  "e  the  hih  block  output  spectral  components.  The  V'„(A  ) 

components  aie  then  subtiacted  fiom  the  coi responding  block  of  desiied  signal  spectial 
components.  to  produce-  the  ('rroi  comijoneiits.  1  he  /:,,{/•)  value’s  are  n.'-ed  te> 

update  the  filter  wc’ights.  Ur.{k-). 

In  all  ca.se’s.  the  index  n  indicates  the  spectral  component,  k  indicates  the  block  being 
|)roce‘.ssed.  and  i  is  the  discrete  time  index.  L3ecau.se  the  FFT  of  a  disewte  tiinesignal  results 
in  coin|)lex  value’s,  the  frec|uem y-domain  nth  bin  ll„{k  )  and  K,.{{y  )  components  arc-  complex. 
Fnlike  time  cloinaiii  adaptive  filtc'is  which  update  the  weight’’  at  each  /.  block  jucKe.ssing 
fillers  (HPF)  u|)dale  once  pet  block.  The  coir.plex  b.M.S  algcnithm  is  ihc*  most  po|)uiai 
weight  update’  algorithm  [2:1-17). 

I.C  Probl(ti)  Slalninnl 

Metgittg  DWT  theoiy  and  I lansform  based  adaplice  fille’i  iheoiv  would  enable'  the- 
de\eloi)tneiit  of  lobust  .self  designing  signal  i>roce.ssois  '.chich  possc'ss  minimal  e om|>ulat ional 
te(|niretnents  suitable  for  applications  which  limit  available  jcowei  and  s[)ace’.  particular!} 
space'-ba.se-d  sigtial  proce.ssing  [11). 
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1.3  Research  Objective 

The  primary  objective  of  this  thesis  is  to  develop  working  frequency-domain  and  Walsh- 
domain  block-processing  adaptive  filters  in  software  and  categorize  their  performance  in 
terms  of  convergence  speed,  output  error,  and  processing  speed. 

1.4  Review  of  Literature 

This  section  presents  a  brief  discussion  of  the  published  research  that  pertains  to  the 
subject  of  this  thesis.  Two  research  efforts  were  found  in  the  literature  pertaining  to  Walsh- 
domain  adaptive  filters.  The  first  concerned  the  haidwaie  implementation  of  a  Walsh-domain 
adaptive  filter.  The  second  presented  an  Adaptnc  Walsh  equalisei.  The  following  sections 
address  each  of  the  two  research  efforts. 

1.4.1  Walsh-Domain  Adaptive  Filter.  Literature  research  revealed  work  done  in 
Walsh-domain  adaptive  filtering  done  by  American  Electronic  Laboratories  [S].  The  W^alsh 
Adaptive  Filter  developed  by  American  Electronics  Laboratories  was  designed  to  adaptively 
filter  pulsed  waveforms  of  varying  widths,  frequency,  and  lime  of  arrival.  The  adaptive  nature 
of  the  filter,  however,  was  in  relation  to  the  threshold  used  and  was  not  LMS  in  nature.  This 
was  not  a  true  Walsh-domain  adaptive  filter  since  the  emphasis  was  on  threshold  but  is  woith 
mentioning  since,  as  far  as  could  be  determined,  it  is  the  onl\  combined  implementation  of 
Walsh  Transform  and  adaptive  filtering  theory. 

1.4.2  Adaptive  Walsh  Equaliser.  The  Adaptive  Walsh  Equaliser  (AWE)  [4]  is  a 
continuous-time  filter  that  performs  linear  convolution  using  a  weighted  sum  of  .4/  vari¬ 
able  coefficient  continuous-time  Walsh  functions.  .Apphing  the  supeiposd'on  piinciple,  the 
continuous-time  input  signal  is  convolved  with  each  of  the  01  thogonal  impulse  iespon.se  Walsh 
components  and  the  individual  responses  aie  .summed  to  pioduce  the  output,  which  is  com¬ 
pared  to  a  desired  signal.  The  impulse  lesponse  comiwnent  weights  aie  adapatively  adjusted 
to  minimize  the  output  error.  This  filtei  operates  in  the  time-domain,  while  this  thesis  in 
vestigates  operation  in  the  sequency-domain. 

1.5  Assiimptions 

The  Walsh-domain  and  frequency-domain  filters  will  be  implemented  in  softwaie  and 
it  is  assumed  that  noise  contributed  by  round-off  errors  and  quantization  effects  due  to 
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finite  word  lengths  is  insignificant.  Enois  of  this  Upe  aic  generalh’  ignoied  since  theii  noise 
contributions  can  be  minimized  with  FIR  filter  implementations  [12:7]. 

1.6  Scope 

The  research  will  be  limiied  to  the  development  of  frequency-domain  and  Walslv 
domain  laptive  filteis  using  tlu'  Fast  LMS  and  Circular  Convolution  frequency-d(Miain 
adaptive  filter  structures  [2:146-157].  A  performance  comparison  of  the  fillers  will  be  made 
with  a  time-domain  LMS  adaptive  filter  based  on  conveigence  speed,  error  performance,  and 
processing  speed.  The  signal  sets  used  are  time-shifted  noi.sy  and  noiseless  sinusoidal  and 
rectangular  signals. 

1.7  Hardware  Reqnircineiils 

This  thesis  requires  a  PC/AT-class  computer  with  at  least  a  51 2K  Ram  Disk.,  640K  of 
base  memory,  and  a  single  flojrpy  drive.  No  additional  hardware  is  required. 

1.8  Softxcare  Requirements 

All  software  programs  de\  eloped  in  this  thesis  were  implemented  using  Tuibo  Pascal 
version  6.0. 

1.9  .‘[pproacli  and  Pn.-f(nlation 

The  approach  used  in  this  research  includes  a  literatuie  search,  .softwaie  implementa¬ 
tion  of  the  W'aish  and  frequency-domain  adaptive  filters,  .software  testing,  and  a  perfoimance 
compaiTson  of  the  filters.  The  remaining  chapters  are  structured  as  follows: 

•  Chapter  II  presents  a  theoielical  analysis  of  Di.screte  Walsh  Tiansform  thcoi\  and  the 
frequency-domain  filters. 

•  Chapter  111  presents  two  Walsh-domain  ada]>ti\e  filteis  developed  b\  extending  the 
frequency-domain  filter  designs  into  the  Walsh-domain. 

•  Chapter  1\’  discusses  the  Walsh  domain  adaptive  filtci  implementations  in  .software 
and  the  tests  used  to  verify  integrity. 

•  Chapter  V  discusses  the  performance  comparison  results. 

•  ChapU'r  VI  piesents  the  conclusions  and  recommendations. 


1.10  Original  Research  Contribalions 

To  the  author’s  knowledge,  the  uniciue  and  significant  contributions  presented  in  this 
research  include: 

1.  Merging  of  Discrete  Walsh  Transform  (DVVT)  theory  and  adaptive  filter  theory. 

2.  .An  extension  of  a  frecjuency-domain  circular  convolution  filter  design  to  a  Walsh- 
doinain  dyadic  convolution  filtei  design,  VValsh-doinain  Filter  1  (WDFl).  that  provides 
a  processing  speed  and  discontinuous  input  signal  filtering  improvement  over  the  Fast 
LMS  and  time-domain  LMS  filters. 

3.  Development  of  a  new  transform-domain  LMS  algorithm.  Walsh  Transfoim  LMS  algo¬ 
rithm  1  (WLMSl),  which  permits  use  of  the  DWT  in  a  freciuency-domain  filter  that 
performs  circular  convolution. 

4.  A  nev\  Walsh-domain  filter  design.  Walsh-domain  Filter  2  (WDF2),  for  a  Walsh-domain 
block  processing  filter  that  uses  a  modified  form  of  the  ”overlap-save"  method,  ha,s 
improved  noisy  input  error  performance  over  the  WDFl  filter,  and  provides  piocessing 
speed  and  discontinuous  input  signal  filtering  improvement  o\ej  the  Fast  LMS  filtei. 
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II.  Background 


This  chapter  presents  the  Walsh-domain  and  adaptive  filter  theory  used  in  the  devel¬ 
opment  of  a  W'albh-domain  adajjtive  filter.  Adaptive  filter  theory  is  presented  in  two  areas: 
time-domain  adaptive  filters  and  block  processing  adaptive  filters.  The  block  piocessii'.r' 
adaptive  filter  discussion  picsonts  the  Fast  LMS  frec|ucncy-domain  iiilei  aiitl  a  Liiciiiai  con¬ 
volution  frecjuenc\-domain  filtei.  Both  filters  are  used  in  Chapter  3  as  lemplate.s  in  the 
design  of  a  Walsh-domain  filter. 


2.1  W(ibh-Domaii)  Theory. 

Signal  processing  of  stochastic  signals  can  be  accomplished  in  a  vaiiety  of  domains,  the 
most  commonh  used  being  time  and  frequency.  There  are  basically  two  reasons  for  choosing 
one  processing  domain  versus  another.  First,  a  computational  advantage  may  be  achieved 
[10].  One  example  is  the  simplicity  achieved  in  performing  the  convolution  of  two  discietely 
sampled  data  sets  with  the  Fast  Fouiiei  Transform  (FFT)  veisus  performing  the  convolution 
sum.  The  second,  information  of  interest  may  be  more  visible  in  one  domain  than  anothci 
[10].  Power  distribution  is  clearly  indicated  in  the  frequency-domain,  whereas  amplitude 
characteristics  are  clearly  indicated  in  the  time-domain. 

2.1.1  nV(/.s/;  Fluid ioit.>.  Walsh  Domain  processing  represents  the  signal  as  a  sum  of 

wt'ighted,  bipolai  puls<‘  waxeforms.  In  the  Walsh-donmin.  (ontmuous  and  disciete  signtds 
are  ie])resented  in  terms  of  an  oithonoimal  set  of  basis  functions  consisting  of  waveforms 
with  discrete  ±1  amplitude  values  [1:17  18].  Walsh  functions  are  defined  over  a  finite  time 
interval,  which  is  usuall\'  normalized  to  one.  and  by  an  ordeiing  number  ii  [1:9-10].  The 
ordciing  numbc'i  specifies  the  numbei  ol  tim<-s  the  function  i>a.sses  thin  zeio  o\('i  the  time 
interval,  and  is  lefeired  to  as  .-^fijiK  ucy  [l:lo].  Di.screte  Walsh  functions  are  deteimined  In 
sam|)ling  the  coricsspondiug  continuous  Walsh  function  at  .V  c;quall.\  spaced  i^oints  o\ei  the 
interval  (0.1 ).  The  lumiber  of  samples.  .V,  must  be  a  power  of  2  [l:o0].  For  a  series  of  .'V  =  2'’ 
terms,  the  discrete  Walsh  functions  can  be  s|)ecified  as  [l:.o9] 

p-\ 

W.AL{n.i)  = 

r=0 

i.n  =  0.1.2 - .'V-1 

r  =  0.1.2 . p-\  (2.1) 
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The  indexes  i.n  are  expressed  in  terms  of  their  binary  digits  such  that 

i  =  {i,,  ip-i  ...  ii  ioh 

n  =  (?!f,  ?)p_i  ...  7?i  7?o)2  (2.2) 

wliere  the  subscript  2  on  the  right  side  of  the  equality  in  Equation  2.2  indicates  tlie  binary 
representation  ol  the  left  side  of  the  equality.  The  leftmost  bit  i.s  the  most  significant.  .An 
example  WAL{n,i)  term  calculation  and  the  first  8  discrete  Walsh  functions  are  presented 
in  Section  A.l. 


2.1.2  Discrete  Walsh  Transform.  The  Discrete  Walsh  Transform  (DWT)  of  a  dis¬ 
cretely  sampled  continuous  time  signal  is  accomplished  generally  in  the  same  manner  as  the 
Discrete  Fouriei  Transform  (DFT).  The  discrete  Walsh  transform  paii  [1:.')0]  is  as  follows: 


A'-l 


a;,  =  l/.¥  x:  .r,lFAT(77.7) 


(2.3) 


1=0 


and 


A'-l 

.r.= 

>1=0 


(2.4) 


The  DWT  spectral  components  an-  represented  by  the  A’„  terms  and  u  is  the  ordering 
numbei.  The  data  sequence  is  indicated  o.\  ,t,.  where  i  is  the  discrete  time  index  while  ,V 
repiescnts  the  numbei  of  data  values  lacing  tiansformed.  The  .\’  input  data  values  being 
transformed  are  not  assumed  to  be  periodic.  The  kernel  of  the  sum.  W.AL(iki),  is  ±1 
depending  upon  the  values  of  7;  and  v  (Equation  2.1).  Because  the  transform  kernel  is  ±1 
the  DWT  lequires  no  multiplies  while  coiner.scly.  the  DFT  re(|uiie.s  complex  multiplies. 
Clearly,  the  DWT  has  a  computational  advantage  over  the  DF’l'.  .As  in  the  case  of  the  DF3’. 
Fast  Walsh  'J'lansunni  (FWT)  algorithms  exist  [1:38-74]  [Tj.  'Fhe  transform  is  linear  [l:o0] 
.so  that  if 

w 


.V,  <- 


A’,, 


and 


then 


w  , . 
y,  < — >  >  ,1 


vv 


a.r,  +  hij,  < — >  c/.V„  -}-  hV,, 


(2.6) 

(2.7) 


•>.o 


where  o  and  b  arc  real  constants  and  W  represents  the  DVVT  operatoi-. 


2. 1.2.1  li'rt/s/?  Matrix.  The  DVVT  can  also  be  repreocnted  as  a  vector  matrix 
multiplication  operation  so  that 

X„  =  (l/yY)W,vx  (2.8) 

where  x  is  the  A’xl  data  sequence  vector,  X„  is  the  A'xl  sj^ectral  component  vector,  and 
VVjV  i-s  the  .A  x.'Y  Walsh  matrix.  The  matrix  \\‘ f,'  and  the  input  vector  x  are  defim. 


HvlL(0,0)  H'.4L(0,1) 

l'r.4L(l,0)  VV4T(1,1) 


U'4/40.A'-  1) 
ir.4L(l,A' -  1) 


(2.9) 


iVAL{N  -\,0)  IV.4L(A'- 1,1) 


W.AL(N  -  I,  N  -1) 


and 

X  =  [.Vo  .Ti  ...  .rA:-,]  (2.10) 

The  rows  of  \\\\  are  the  first  A’  Walsh  functions,  where  the  sequency  0  function  is  the  first 
row.  and  the  matrix  is  diagonally  symmetric.  The  first  .\'/2  columns  are  characterized  by 
the  lad  that,  in  numbeiing  the  first  row  0.  the  e\en  and  consecutive  odd  numbered  rows 
are  equal:  foi  example  row0=iowl  and  row2=iow3.  This  chaiacteiistic  will  be  referred  to 
as  low  symmetry. 

'I'he  significance  ol  the  row  symmetry  characteristic  can  be  seen  when  liansforming 
zero  end-padded  sequences.  .An  X/2  zero  end-padded  input  data  vectoi  produces  a  spectium 
where,  stai ting  wit h  the  0  spectrum  component.  thee\en  numbeied  components  are  ecpial  to 
I  heir  consecutive  odd  numbered  components:  for  example  .Vo  ==  .V|  and  A'^  =  AA-  Therefore. 
th<-  resulting  spectrum  is  component  symmetiic.  Example'  Disciete  Walsh  Tiansforms  of  zeio 
end-padded  vectors  are  pre.sented  in  Section  .A. 2. 


2. 1.2. 2  .Spectrum  Chnractcristicf^.  ".An  important  feature  of  the  pow'er  spec¬ 
trum  using  Walsh  lunctions  is  that  it  is  possible  foi  the  power  spectrum  to  be  sc(|uenc\ 
limited  although  the  corresponding  time  functions  aie  time'  limited"  [l:l03j.  In  compaii- 
son,  the  corresponding  frequency  spectrum  foi  time-limited  waveforms  cannot  be  frequence 
limilc'd.  The  representation  of  a  continuous  waeefoim  with  Walsh  functions  resull.s  in  a 
more  complex  spectrum  than  that  produced  using  Fourier  analesis  [1:103].  Comer.sc'le.  the 


rei^resentalion  of  dibcontinuoira  wa\efornis  using  Fomiei  analysis  results  in  a  more  complex 
spectrum  than  that  produced  using  Walsh  functions. 

•Simple  rectangular  and  sinusoidal  waveforms  are  examples  of  discontinuous  and  con¬ 
tinuous  waveforms,  respectively.  In  the  case  of  periodic  signals,  the  DWT  of  <.  re  period 
of  the  signal  produces  a  different  sequency  spectrum  than  the  DWT  of  two  periods.  This 
characteristic  is  demonstrated  in  Section  .A.. 3  for  a  simple  &inu.soid  and  rectangular  signal. 
The  sunr  of  the  sequency  components  squared  equals  the  input  signal  power. 

2.1.3  Circular  Time  Shift  EJJccts.  Unlike  the  DFT,  the  DWT  does  not  possess  a 
circular  shift  pi'operty  [Uol].  Given  a  sequence  .r,  which  produces  a  DFT  AT,  the  ciixularly 
shifted  sequence  produces  a  DFT  of  AT.  The  spectrum  of  the  circularly 

shifted  sequence  retains  the  same  magnitude  characteristics  as  the  spectrum  of  the  unshifted 
.sequence  but  possesses  a  different  pha.se  characteristic.  I'herefore,  the  DFT  is  referred  to 
as  a  shift  invariant  transform.  The  shift  variant  nature  of  the  DWT  is  demonstrated  in 
Section  .A. 3  for  a  simple  sinusoid  and  r'cctangular  signal. 

2.1./,  Convolution.  The  linear  convolution  of  two  discrete  N  point  sequences  .r,  and 
y,  in  the  time  domain  is  defined  as 


=  i;' -r,!/,-,  (2.11) 

1=0 

The  con\olulion  theorem  for  the  Fourier  Trarrsform  stale.s  that  the  convolution  of  two  N- 
poim  time  series  .r,  and  y,  can  be  performed  by  rmrltipl)  ing  the  I'ourier  Transfor  ms  of  the  two 
.series  and  taking  the  inverse  transform  of  the  product.  This  results  in  circular  convolution 
(lire  to  the  fact  that  the  DFl’  assumes  the  .sequences  to  l>e  periodic.  Therefore  it  is  rrece-ssary 
to  |)ad  the  .secjirerrces  with  i\’  zeros,  transform  the  2.\-point  series,  mrrllipiy  the  2i\'-poinl 
DF'I's  of  the  two  sequetrees.  arrd  irrver.se  Irarrsfornr  the  result  to  perform  linear  convolution 
in  the  time  domain. 

In  the  ca.se  of  the  DW'T.  no  relatiorrship  exists  with  regard  to  perforrrrirrg  linear  time 
domain  convolutiorr.  This  is  demorrstrated  by  repiacirrg  .r,  arrd  //r..,  irr  Eqrration  2.11  with 
their  ecjtrivalent  i)rver-.se  Discrete  Walsh  Trarrsform.  Performing  this  substituliorr  gives  [l;!)f)] 

=  EIE  .v„ii'.i/.(>i.oiiE'  );ii’.i/.(i.-  -  ;)i 

;=0  ll=()  1=0 
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(2.12) 


(2.13) 


=  E  E  v;ie'  wAL(k,  Dll'  ■.1(1. 7  -  i)i 

>!=0  /=o  t=0 

The  brackeied  bum  term  represents  the  convolution  of  i  e  discrete  Walsli  functions,  and 
demonstrates  the  fact  that  linear  time  convolution  is  noi  achieved.  What  is  achieved,  is 
reierrcd  to  as  dxyadic  convolution. 

The  Walsh  addition  theorem  [1:53]  states  the  following  relationship 

WAL{n,i)W.AL{m,i)=  WAL{n^iv.i)  (2.14) 


where  vj  indicates  modulo-2  addition  for  the  binary  representations  of  ;;  and  m.  Dyadic 
convolution  is  defined  as  (IrlOOj 


A'-l 

1=0 


and  substituting  the  Discrete  Walsh  Tr<insform  (DWT  )  e.\pression  for  into  Equation  2.15 
produces  (1:100) 


.r,i’^'i;,ir.4/,(.,.74.i)l 


n=0 

■Applying  I  he  addit  ion  theorem  (Ecjualion  2.14  <o  Equation  2.16  produces  [1:100] 


(2.16) 


A'-l  ,A'-1 

=r  =  1/A'  ■T,lE.4A(7).f)l'r,4/,(7(.r) 

)I=0  :=0 

A'-l 

=  ATVJE.4/.(n.-) 

H  =  0 

wliicli  oslablislic.s  (1*0  relationship 

. \r  y.* 

r^i/i  ^  ^  7i  ' 


(2.17) 


where  W  is  the  DWT  opeiatoi.  In  compaii.son.  this  realtionship  demonstiates  that  distinct 
.sets  of  relationships  e.xist  for  the  Walsh  and  Fourier  seiies.  Each  establishes  a  form  of 


convolution  t!ieor\  with  the  dihcreiicc  being  that  the  Fourier  veision  utilizes  aiitlunetic 
addition  for  the  lecursive  time  shift  and  the  Walsh  version  utilizes  modulo-2  addition. 

Dyadic  convolution  is  similar  to  circular  convolution  in  that  there  are  A'  product  terms 
associated  with  the  lesull  at  each  r  shift  when  convolving  two  A'  point  secjuences.  Linear 
convolution  produces  r  -{-  1  product  terms  for  each  r  shift.  An  e.xample  is  presented  in 
Section  .A. 2  that  demonstrates  the  relationship  stated  in  Ecjuation  2. IS. 

2.1.5  Correlation.  Discrete  autocorrelation  in  real  time  is  defined  by  [l;100] 

A- -I 

/?.  =  l/A'- ^  (2.19) 

1=0 

wdiere  <  =  0,1.2 . m  and  m-cA'.  The  constant  m  represents  the  total  correlation  lag. 

Discrete  autocorrelation  in  dyadic  time  is  defined  b}'  [1:100] 

A'-l 

/?,  =  lA'Y  X:  x,a:,e  (2.20) 

1=0 

Since  modulo-2  addition  and  subtiaction  aie  identical  operations,  dyadic  coinolutioii  and 
correlation  produce  the  same  result  (1:101).  Correlation  of  .r,  and  ;/,  can  be  accomplished 
by  multiplying  the  .r,  seciuence  Dl  'f  conjugate  and  the  y,  se(|ueiice  DF T.  This  is  shown  by 
ap|)l\ing  the  convolution  theorem  for  the  ourier  series  and  the  relationship 

x.,^Xl  (2.21) 

where  T  is  the  DFT  opeialor.  flie  inveise  DPT  |)roduce.s  the  cro.ss-correlation  of  .r,  and  y,. 
No  such  relationship  e.xisis  for  DWTs  since  the  DW'I  romponeiits  are  real. 

2.2  .Ailaplire  I'Uhr.'i. 

.\n  adaptive  filter  is  a  signal  proce,ssor  that  posses.ses  .seif  adjust iiig  capalnlitv  and  is 
time  varying  [3:2  1  ij.  d'he  filter  is  continually  modifying  its  current  state  ii,  resi)onse  to 
input  and  output  signals  [3:2-1  l|.  d  ue  most  common  form  of  adaptive  filter  used  in  signal 
pioce.ssing  is  the  <  losed- loop,  which  is  illustialed  in  l’igurc2.1.  This  filtei  piocc.->ses  '.he  ininit 
to  yield  an  outi^ul  //,  w  hich  is  cornpaied  against  a  desired  signal  d,.  \  ielding  an  ei  rca  signal 
c,.  The  desired  signal,  r/,.  serves  a.s  a  "Irolniny  .'^lyiinF  foi  the  filler  [ttilSj.  .All  lliiee  vaiiab'es 
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Figure  2.1.  Adaptive  Filter  Block  Diagram 


represent  discrete  values  and  the  subscript  i  represents  the  discrete  time  index.  Adapti\e 
filters  can  be  implemented  as  time  domain  filters  oi  as  tiansform  based  filters,  also  referred 
to  as  block  processing  adaptive  filters. 

2.2.1  Tiih(-(lotnain  .Adaptive  Filters.  The  single-inpul  time-domain  LMS  adaptive 
fib'  •  processor  structure  used  in  this  thesis  is  lefeired  to  as  an  Adaptive  Trans •ersal  Filter 
[b  f,  \s  shown  in  Figure  2.2.  the  Auat  dve  Transversal  Filler  is  essential'',  a  Finite  Impulse 
P  spouse  (Fib)  digital  filtei  with  adaptive  weights  that  are  represeiiled  such  th.it  the  ^’th 

lap  at  lime  i  is  lij{i)-,  where  j  -=  0. 1 . L.  .Assuming  a  causal  filter,  the  liltci  size  is  Z.  -1-  1. 

Weight  update  at  time  i  is  most  a/nimonly  pcrformerl  using  the  \\  idunv-lloff  LMS  algorithm 
[!):100].  Filter  weight  v.dues  arc  collectively  represemed  as  a  weight  vpctoi  which  is  defined 
as  follow.s: 

h(/)  =  [hoii)  lh(i)  -  (2-22) 

d  he  filtci  output  at  tiiiic  i  is  pioduced  bom  the  liiu’ai  < ombination  of  ])ioducts  formed  by 
multi|)lying  I  he  filter  weights  with  theii  roi  i<*spoiiding  delaxed  input  signal  \alues  as  specified 
by  [9:17) 


=  J^.r,.il>i{i) 

1=0 

=  s'am 


V. 


Figure  2.2.  .Adaptive  Tran.sveisal  Filter 


where 

x(i)  =  [.-i:,-  .T;_i  ...  Xi-if  (2.24) 

The  error  signal  is  specified  by  [9:19] 

e.-  =  (h  -  y, 

=  d,  -  x’'(/)h(0  (2.25) 

.\.s  a  measure  of  optimal  peiformance,  the  LMS  adaptive  filter  seeks  to  minimize  the 
mean  sciuared  error  with  the  ideal  case  typically  being  /iftf]  =  0  [3:2-10].  The  mean 

squared  error  is  defined  as  follows  [3:2-16]: 

=  £K')  +  £'(h’(-)|£|x(0x''(,)|E|M>)l  -  2/i;[</,x’'(;)|;i:|i.(;)| 

=  £|</?|  +  ii'''(;)i'|x(;)x’'(,)|ii(;)  -  ae  irf,x’(.)|h{i)  (2.26) 


There  are  two  key  a.ssiimptions  made  in  the  derivation  of  Equation  2.26.  First,  in 
piogiessing  from  the  first  to  the  second  line,  the  weight  vectoi  and  the  input  signal  vectoi 
are  a.ssumed  uncorrelaled.  d'he  second  assumption  is  that  the  weight  vectoi  (onveiges  to  a 
solution.  When  the  weight  vecto''  converges  E'[h(7  -k  1)  -  h(?)]  equals  the  zero  vector  and  the 
weight  vectoi  can  be  tieatcd  as  a  constant.  'I'liis  leads  to  the  final  foim  of  Equation  2.26. 


.vhich  is  (9:20] 


R  =  £|x(i)x’'(<)l  = 


=  Eicij]  +  h'^Rh  -  2P^'h 

(2.27) 

X  and  is 

defined  as  (3:2-1' 

$*ra;(0) 

4>xx{~P) 

^rx(f ) 

©Tr(0) 

^XX  (1  -^  ) 

d>xxi2) 

®rr(-l) 

<f>xx{2-L) 

(2.28) 

<f>xx{L  -  1)  •  •  • 

Oxx{0) 

and  Orxif^)  =  P  is  the  cross  correlation  vector 


P  =  i?[d.x(z-)]  = 


^d.(0) 

<^dx{-P) 


(2.29) 


where  6dx{^^)  =  ir{r/,.r,+„].  Under  the  assumption  that  the  input  signal  and  desired  signal 
are  stationary,  R  and  P  are  constant  and  as  such  iec|uirc  no  time  sub.script . 

Eciuation  2.27  is  referred  to  as  the  performance  ecpiation  or  niean-sc|uare  error(.MSE) 
eejuation  for  the  LMS  filter.  Equation  2.27  characterizes  a  performance  surface  which  the 
filtei  searches  to  find  the  global  minimum  which  is  guaranteed  to  exist  by  the  quadratic 
nature  of  the  ecpiation.  The  weight  vectoi  that  satisfies  the  global  minimum  is  referred  to  as 
h„,,,.  .Sohing  for  h.,,,/  requires  taking  the  gradient  of  E{c^]-  and  setting  the  giadicnt  equal  to 
the  zero  vector.  The  gradient  is  being  taken  with  lespect  to  the  weight  voctoi  lU.  Defining 
tile  gradient  vector  V„.  as  (9:2-18] 


^,,.F=[dF/dwo  dP/dw,  ...  dFIdwiC' 


(2..30) 
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where  F  represents  a  function  of  w  and  the  gradient  operator.  .Applying  the  operator 
to  Equation  2.27  and  solving  for  the  minimum  produces  [9:21): 

■  0  =  v„.£:[d.)  +  V  j/y?h  -  Vu,2/^^h 

=  0  +  V^(h^')(/?h)  -  V,,2P^h 

=  2Rh-2P  (2..31) 

where  the  left  side  of  the  equality  is  the  zero  vector.  Evaluating  Equation  2.31  for  h  yields 
ho,,«  such  that  [9:22] 

hop,  =  /?-'P  (2.32) 

.An  important  footnote  to  this  result  is  that  this  assumes  R  to  be  invertible  [9:2-18].  Substi¬ 
tuting  Equation  2.-32  into  Equation  2.31  for  h  yields  the  minimum  mean  square  error,  which 
is  specified  as  [9:22] 

Un  =  F[d]]-P'^R-'P  (2.33) 

Equations  2.32  and  2.33  clearly  show  that  the  optimum  filter  solution  and  the  optimum 
MSE  performance  depends  on  the  autocorrelation  and  crosscorrelation  statistics.  For  an 
input  signal  that  is  statistically  wide  sense  stationar\.  the  R  matrix  can  be  evaluated  and  will 
be  compo.scd  of  constants.  Evaluation  of  the  P  vector  is  a'-complished  bj  cross  correlating 
x(/)  and  (I,.  The  performance  surface  defined  by  Equation  2.27  as  mentioned  earlier  is 
quadratic  in  nature. 

The  gradient  at  an}'  point  on  the  performance  surface  corresponds  proportionately  to 
the  surface  slope.  The  rate  with  which  the  weight  vector  converges  also  is  proportional  to 
the  gradient  and  therefore  the  surface  slope. 

.A  |)opulai  measure  of  adaptive  filter  performance  is  the  Icnniing  curve  whicl  n.easures 
the  .MSE  as  a  function  of  time  [10].  Generally.  E'[(.*]  is  estimated  by  ensemble  ave, aging 
versus  i  over  a  number  of  individual  runs  of  the  input.  The  minimum  MSE  or  Gum  occurs 
when  the  filter  taps  have  reached  thci>.  optimum  solution  as  defined  in  Equation  2.-32.  In 
most  ca.scs.  an  exact  match  with  the  desired  signal  is  not  achieved  due  to  .adaptation  noise 
in  the  filter  tap  update  and  noise  in  the  filter  input  .r,  [10]. 

The  filter  weights  for  each  tap  position  are  updated  using  the  L.MS  algorithm: 

h(/  r  1)  =  h(/)  +  2iic,K{i)  (2.3-1) 
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after  eacli  time  iii.staiit.  Uibed  upon  the  enui  differeiite  t,  Ijetweeii  the  filter  output  y,  ami 
the  debired  signal  d,.  The  constant  //  is  referred  to  as  the  gain  constant  and  is  used  to  adjust 
ada[)tation  speed  and  control  the  stability  of  adaptation  [U.lOOj.  The  filter  searches  the 
performance  suiface  for  the  global  minimum  using  the  LMS  algoiithm.  As  the  input  data 
is  piocessed.  the  LMS  algorithm  uses  a  gradient  estimate  derived  from  the  instantaneous 
error  to  search  the  Performance  Surface  (9:99  100).  As  stated  in  Erpiation  2.31.  the  ne.xt 
weight  vector.  h(/  T  1);  is  calculated  by  adjusting  the  previous  weight  vector  by  the  scaled 
product  of  the  instantaneous  error  and  input  vector.  In  the  case  of  nonstationar>  signals,  if 
the  statistics  vary  slowly,  the  gain  constant  y  can  be  increased  to  allow  the  filter  to  track 
t  he  nonstationarit}  at  the  exjx’iise  of  increased  adaptation  noise.  Foi  rapidly  changing  input 
signal  statistics,  the  filter  will  not  converge  to  an  optimum  weight  solution  [3:2-21]. 

2.2.2  Bloch  Bi'occ^^iny  Adaptive  Fillers.  This  section  presents  the  Fast  LMS  adaptive 
filter  and  a  circular  convolution  frecpienc}  domain  filter.  For  each  filter,  the  presentation  is 
as  follow.s: 

1.  Time-domain  input  vector  definition. 

2.  Frequency-domain  input. 

3.  Output  Calcidation. 

•1.  Fre(|uency-domain  weight  upfiale. 

5.  Time-domain  repre.sentation. 

6.  Optimum  weight  vector. 

7.  Computational  requirements  in  terms  of  multiplications. 

2.2.2.  /  Cirrnlnr  ( 'ooroliitiou  .Model  One  significant  dilference  in  the  implemen- 
tatioii  of  a  tiansfoim  ba.s»*d  adaptive  filter  versus  a  time domain  filt«‘i  is  that  the  <iata  is 
processed  in  blocks  [2:1  iGj.  .\  fre<|uenc>  domain  adaptive  filter  that  i)erf«jrms  circular  con 
voluliem  is  depicted  in  Figure  2.3  [2:1  17]  and  will  be  referred  to  in  the  lemaindei  of  this 
thc'sis  as  lTe(|uencv  clom.  .n  Filter  1  (FDFI).  The  blcjck  proce.ssing  nature-  of  this  filter  is 
reflected  in  f  igure  2.3  using  the  notation  \(h).  d(F).  and  \(Fj;  which  repre.sent  tiie  hlh  block 
input  vector  de.sir<-d  vector,  and  out  put  vector  respectively. 
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FDFl  Time-domain  Input  Vector  Definition.  The  first  step  in  presenting 
the  frequency-domain  equations  is  to  define  the  filter  input  vectors.  Letting  x,  represent 
the  input  sequence,  the  N  input  sequence  \ allies  which  define  the  kih  input  block  can  be 
represented  by  XkN+,,  where  i  =  0,1, . . .  ,N  -  1.  Using  this  notation,  the  N-point  k'th  block 
input  vector  is  defined 

x(A')  =  . . .  xk^+i^-i]'^  (2.35) 

Applying  the  same  notation  to  the  desired  time-domain  sequence,  the  associated  /rth  block 
desired  vector  is  represented  as 

e\{k)  =  [dkN  dkN+N-\V  (2.36) 

FDFl  Frequency-domain  Input.  The  A'th  block  input  vector  transform 
components  define  the  diagonal  components  of  the  A’th  block  input  FFT  matrix  X(A’)  [2:148]: 

X(A’)  =  diay{IF{[x(kN)  •^■(fcN+A'-i)]^}} 

Ao(A’)  0 

X^{k) 

0  -V,v_,(A’) 

where  F  represents  the  forward  FFT  operator. 

The  Aih  block  desired  vector  transform  components  define  the  A’th  block  frequency- 
domain  desired  vector  D(A’),  defined  by 

D(k)  =  F{{d^^;^<)  ...  d^k.\’+,\!-\)]' }  (2.38) 

and 

Do{k) 

Dfik) 

D^’-]{k) 


FDFl  Output  Calculation.  The  transform  components  of  the  /rth  input 
block,  ai'e  multiplied  with  the  respective  ^'th  block  frequency-domain  filter  weights, 

Hnik),  to  produce  the  kth  block  output  spectral  components,  Yn{k)  [2:148-149]: 

Y{k)  =  X(A')H(A-)  (2.40) 

where 

H(A)  =  [i/o(A’)  //i(A-)  ...  Ilv.,{k)f  (2.41) 

Taking  the  inverse  FFT  of  Y(A’)  produces  the  A-th  block  output  vector.  Representing  the 

iV  output  sequence  values  as  ?/a-;V+m  "'here  i  =  0,1, - A’  —  1,  the  A-th  block  time-domain 

output  block  vector  is  defined 


y(^')  =  (l/t/.-.V),  -  •  .,y{kN+N-})f 


(2.42) 


and 

y(A-)  =  ;^-MX(A-)H(A-))  (2.43) 

The  operator  used  in  Equation  2.43  is  the  inverse  FFT  operator. 

FDFl  Fi'equency-domain  Weight  Update.  .Analogous  to  the  time-domain 
LMS  filter  weight  update,  the  output  spectral  components.  1„(A-).  aie  subtracted  from 
the  corresponding  desired  signal  spectral  components.  Ai(A’).  to  produce  the  Ath  block 
frequency-domair  error  components,  E„{k)  [2:149]: 

E(A-)  =  D(A-)-Y(A-)  (2.44) 

I'he  En{k)  values  are  used  to  update  the  frequency-domain  filter  weights,  Jl„{k) 

I1(A--}-])  =  11(A) -}-//X‘(A-)E(A-) 

=  H(A)  -p  /t[X'(A)D(A)  -  X'(A)X(A)H(A)] 

=  H(A)-{-//Vn(A) 


(2.45) 


where  /i  is  again  the  convergence  constant,  X*(^')  is  the  complex  conjugate  of  X(k),  and 
V fi{k)  represents  the  frequency-domain  gradient  vector  for  FDFl  [2:149].  fi{^)  is  defined 


<] 

o 

X^{k)[Doik)  -  Xo{k)Ho{k)] 

Vn(/r)  = 

Vri.(^') 

= 

X;{k){D,{k)-Xr{k)H,{k)] 

Vfiw_,(^’) 

x;,_,{k)[D^.,ik)  -  Xi,.,ik)HN-m 

Equation  2.45  shows  that  the  FDFl  Weight  update  is  accomplished  once  per  block  as  opposed 
to  each  discrete  time,  i,  increment. 

For  the  previous  discussion,  in  all  cases,  the  index  n  indicates  the  spectral  component. 
k  indicates  the  block  being  processed,  and  i  is  the  discrete  time  index.  Also,  because  the 
FFT  of  a  discrete  time  signal  results  in  complex  values,  the  frequency-domain  components 
Hn{k),  En{k),  Xn{k),  Du{k),  and  V'„(A;)  are  generally  complex. 

For  each  block  of  input  data  processed,  the  filter  attempts  to  minimize  the  MSE  be¬ 
tween  the  desired  spectral  components  and  the  input  spectral  components.  This  filter  re¬ 
quires  stationary  inputs  for  the  weights  to  converge. 

FDFl  Time-domain  Representation.  The  equivalent  time-domain  repre¬ 
sentation  of  Equation  2.45  is  as  follows  [2:149]: 

h{h + 1)  =  m + -  j:’x(i-)h(*)i  in') 


where 

h{k)  =  T'^]](k)  (2.48) 

with  the  vector  format  specified  as 

h(k)  =  [lio{k)  ln(k)  ...  /(A'-i(fc)F'  (2.49) 

The  symbol  x(A-)  represents  a  circulant  matrix  [2:149]  given  by 

Xik)  =  T-^X{k)E  (2..50) 
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and 


xo{k)  X(Ar_i)(^')  ...  xi{k) 

X,{k)  Xo{k)  ...  X2{k) 

XM-i{k)  X!^--2{k)  ...  XQ{k) 

The  first  column  of  x{k)  is  the  input  vector  x{k)  since  x{k)  is  the  inverse  FFT  of  the  diagonal 
elements  of  X{k).  By  expressing  the  zth  row  of  x{k)  as  xj  {k),  Equation  2.47  can  be  rewiilleii 
as  ^ 

h{k  +  1)  =  h{k)  +  M  f;  [d,ik)xiik)  -  yiik)x,{k)]  (2.52) 

t=0 

with  tji{k)  representing  the  zth  component,  where  i  =  0.  ..N  —  1,  of  the  kih  block  output 
vector  (Equation  2.43).  The  output  vector  y{k)  contains  the  N  output  values  for  the  /rth 
output  block  of  the  filter.  FDFl  output  values  for  the  kih  block  are  calculated  in  the  time- 
domain  by  performing  the  circular  convolution  of  h{k)  and  x{k).  Using  the  circulant  matrix, 
the  ^'th  block  output  vector  is  defined  [2:149] 

y{k)  =  x{k)\m  (2.53) 

Substituting  e,(A’)  =  d,{k)  —  ?/,(A*).  where  d,(A')  represents  the  zth  component  of  d(A-) 
(Equation  2.36),  into  Equation  2.52  produces 

h{k  +  l)  =  h{k)  +  yY^c,(k)x,ik)  (2..54) 

1=0 

where  x,(A-)  once  again  represents  the  zth  row  of  x{k)-  Equation  2.-54  reveals  a  distinct 
departure  from  the  standaid  LMS  algorithm  relating  to  the  gradient  estimate.  In  this  case, 
even  though  weight  update  occurs  only  once  per  block,  the  giadient  estimate  is  calculated 
a.s  a  recursive  sum  over  the  input  block. 

FDFl  Ophnunn  Weight  Vector.  The  first  step  in  deriving  an  FDFl  op¬ 
timal  time-domain  weight  vector  expression  is  the  deiivalion  of  an  cqui\alenl  frecpiency 
domain  cxpiession.  The  optimum  frequency-domain  weight  vector  minimizes  [2:150] 

=  £|(D(J-)  -  Y(t))-(Dn-)  -  Y(i-)| 


2-i(; 


=  E[D-{h)D{k)]  -  R;,H  -  +  H‘R,,H 


(2.55) 


where 


Rxrf  =  E[X'{k)D{k)] 

(2.56) 

Rxx  =  E[X'{k)X{k)] 

(2.-57) 

Since  d  and  x  are  btationary,  Rxx  is  a  diagonal  matrix  and  the  7rth  diagonal  element  is  given 
by  E[X‘{k)Xu{k)].  The  ??th  element  of  R^d  is  £^[A''“(A’)I)„(A:)]  [2:150].  Taking  the  gradient 
of  Equation  2.55  with  respect  to  H,  setting  the  result  equal  to  the  zero  vector,  and  solving 
for  Hop/  produces  [2:150]. 

Hop/  =  Rxi-Hi-d  (2.58) 

The  optimum  time-domain  weight  vector  is  calculated  by  taking  the  inverse  FFT  of 
Equation  2.58  which  produces  the  optimum  time-domain  weight  vector  for  a  circularly  con¬ 
volving  filter  [2:150]: 

hop/  =  (2.59) 

where 

rxr  =  (2.60) 

and 

=  (2.61) 

The  matrix  ixi  is  a  circulant  matrix,  because  Rix  is  a  diagonal  matrix  [2:150].  Characteris¬ 

tically,  the  first  low  of  r^x  contains  lags  zero  through  N  -  1  of  the  circular  autocorrelation 
function  of  the  input  x  [2:150].  Using  the  linear  autocorrelation  function  cf»(/).  the  circular 
autocorrelation  function  at  lag  i.  0c{i),  can  be  expressed  as  [2:150] 

Pe(?)  =  +  j^d)(i  -  N)  (2.62) 

Similarly,  the  circulai  cross-coi  relation  of  .r  and  d  generates  teims  that  compii.se  the  elements 
of  the  vector  ivj  [2:150]. 


FDFl  Computational  Requirements.  A  computational  reduction  is  achieved 
with  the  FDFl  filtei  versus  tlie  lime-domain  adaptive  filter  in  terms  of  multiplication  opera- 


N 

FDFl  Real  Multiplies 

LMS  Real  Multiplies 

4 

1.375 

8 

0.875 

16 

0.531 

32 

0.313 

64 

0.180 

256 

0.056 

1024 

0.017 

Table  2.1.  FDFl  vs  LMS  Real  Multiplies 


lions  required  [2:147].  The  FDFl  filter  uses  three  .'V-point  FFTs  and  2.V  complex  multiplies 
to  calculate  A'^-output  points. 

An  A^-point  FFT  can  be  accomplished  using  an  A72-point  FFT  and  A72  complex 
multiplies  [2:147].  Computationally,  a  A72-point  FFT  requires  (A74)  log2(A72)  —  N/2  com¬ 
plex  multiplies  so  that  a  total  of  (A74)  log2(A72)  complex  multiplies  are  performed  in  each 
A^-point  FFT  [2:148].  Adding  2N  complex  multiplies  to  the  complex  multiplies  associated 
with  three  A’-point  FFTs  gives  a  total  of  (3A74) log2(.'V/‘-)  +  2A'  complex  multiplies  per  N 
output  point.s  produced.  An  A'-tap  time-domain  LM.S  filter  requires  2A'^  real  multiplies  to 
produce  A'  out])Ut  data  points  [2:147]. 

.Assuming  four  real  multiplies  is  equivalent  to  one  complex  multiply,  the  latio  of  FDFl 
real  multiplies  to  LMS  real  multiplies  is 

FDFlRcal Multiplies  .3/2  log.2(.A72) -}- 4  p'>  r-'>\ 

LMS  Real  Multiplies  ^ 

The  computational  savings  is  significant  for  large  filleis.  as  demonstrated  in  Table  2.1. 

2. 2. 2. 2  Fast  LMS  f'ilter  In  general,  adaptive  filters  which  peiform  linear  con¬ 
volution  are  moie  useful  for  digital  filtering  [2:152].  1'he  Fast  least-mean-square  adaptive 
filter  (FLMS)  [2:152-157]  described  in  this  section  performs  stiictly  lineai  convolution:  as 
opposed  to  the  stiicti\  circular  convolution  model  discussed  eailiei.  This  filter  will  be  re¬ 
ferred  to  as  Frequei.ey-domain  Filter  2  (FDF2)  throughout  the  remainder  of  this  thesis.  The 
FDF2  filter,  depicted  in  Figure  2.4.  is  a  block- i)rocc.ssing  adaptive  filler  that  produces  A’ 
output  data  values  dining  each  weight  update  c>cle.  In  piodiuing  .V  output  values,  the 
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Figure  2.4.  Freciucncy-cloinain  FIIUm-  2  (FDF2) 
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filter  is  utilizing  2N  input  data  values,  as  opposed  to  the  N  values  used  by  the  FDFl  filter. 
The  kih  block  input  values  consist  of  the  N  point  current  and  N  point  previous  input  blocks. 

PDFS  Time-domain  Input  Vector  Definition.  Using  the  notation  .t,  to 
represent  the  input  sequence,  the  N  input  sequence  values  which  define  the  /:th  input  block 
can  be  represented  by  where  i  =  0, -  1.  Referring  to  Figure  2.4,  the  A-th 

block  input  vector  x(A’)  is  composed  of  the  concatenated  N-point  previous  block  and  N-point 
current  block  which  defines  a  50%  overlap  of  the  A-  -  1  and  k  N-point  blocks.  Therefore,  the 
A'th  block  input  vector  is  defined 

x(A-)  =  [.T(a..a;_a')  a:(;,,v+yv-i))'^  (2.64) 

- - V - '  ' - V - ' 

(A*- 1  )i/i  6/oc/:  kth  block 

The  A'th  block  desired  vector  d(A')  follows  the  FDFl  definition  (Equation  2.36). 

The  additional  input  used  during  each  block  is  due  to  the  fact  that  the  FL.MS  adaptive 
filter  utilizes  the  “overlap-save”  method  in  performing  linear  convolution.  The  “overlap- 
save”  method  “. . .  corresponds  to  implementing  ^  n  I-point  circular  convolution  of  a  P-point 
impulse  response  h(A)  with  an  I-point  segment  x(A)  and  identifying  the  part  of  the  ciicular 
convolution  that  corresponds  to  a  linear  convolution.  The  resulting  output  segments  are 
then  patched  together  to  form  the  output"  [5:558].  Performing  the  ciiculai  convolution  of 
an  A-point  seciuence  with  a  P-point  sequence  {P  <  L)  results  in  an  output  so(|Ucnce  with  the 
first  (P  —  1)  ])oints  incoiiect  in  the  context  of  linear  convolution.  The  remaining  points  match 
the  linear  convolution  result  [5:558].  In  this  case,  a  50%,  overlap  is  employed  (A/2  =  .V  =  P) 
which  has  proven  to  be  the  most  efficient  [2:153]. 

FDF'2  Frequency- domain  Input.  For  the  Ath  block,  the  2.N  data  points 
comprising  the  Ath  block  input  vector  x(A)  are  liansfoimed  using  the  Fast  Fouiiei  Tiaiisfoim 
(FFT).  The  Ath  block  input  vcctoi  transform  component.s  define  the  diagonal  components 
of  the  Ath  block  input  h'FT  matrix  X(A)  [2;1.53]: 

X(A)  =  f//V/i^{.P'[.r(i,A'-,V)  ■■■  •'C(A-A--i)  ■■■  .r(A.A'+;V-i)]^} 

' - - ' 

{h-\)lhblvcl;  kth  block 
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where  T  is  the  forward  FFT  operator. 


FDF2  Output  Calculation.  Representing  the  N  output  sequence  values 
which  define  the  fcth  output  block  as  PkN+i-,  where  i  =  0, 1, . . . ,  —  1,  the  A'th  block  time- 

domain  output  block  vector  is  defined  [2:15.3] 

y(A-)  =  [y[kN),- ■  ■  OJ(h^'+N-\)V 

=  last  N  teryvs  of  {X{k)E{k)}  (2.66) 

where 

H(A-)  =  [Hoik)  H,{k)  . . .  H.,N-,{k)f  (2.67) 

FDF2  Frequency- domain  Weight  Update.  After  producing  the  A*th  output 
block  the  A''  time-domain  error  samples  for  the  A-th  block  arc  derived  usi:ig 

<iki\+t  =  d;..iv+,  -  yi;N+,  (2.68) 

where  k  represents  the  current  block  and  i  ~  0. .  .A  —  1.  The  time-domain  error  samples  are 
transformed  to  create  the  frequency-domain  error  vector  E(A’),  which  is  used  to  deiive  the 
2.^'’-point  FDF2  frequency  domain  gradient  vector  ^r2{k). 

The  FDF2  frequence -domain  weight  update  algorithm  differs  from  that  used  by  FDFl 
in  that  a  gradient  constiaint  is  employed.  The  gradient  constiaint  ])rocedurc  is  identified 
in  Figure  2.4  as  the  dotted  portion  of  the  figure.  The  i)roduct  of  the  2A’x2A'  A'th  block 
transform  input  matrix  conjugate  (X*(A'))  and  the  2A'xl  frequency-domain  error  vector 
(E(A'))  is  the  Gradient  Constraint  input.  Since  only  A'  error  terms  are  generated  from  the 
2A’  input  values  used,  the  A’-poinl  A'th  time-domain  error  block  .sequence  must  be  padded 
with  .V  preceding  zeros  in  order  to  generate  a  2A'-point  frequency  domain  error  vector.  Thus. 


the  frequency -domain  error  vector  for  the  kth  block  is  [2:154); 


E{k)  =  .^{[0  ■  ■  ■  0^  {d{kN)  -  y(kN)) 

N  zeros 


■  ■  •  {d(kN-i-N-l)  -  ?/(A-A'+/V-i))]^  ) 
kth  error  block 


(2.69) 


The  first  step  in  the  Gradient  Constraint  procedure  is  to  inverse  transform  the  X‘{k)E{k) 
product  and  save  only  the  first  N  values.  This  result  defines  the  FDFl  time-domain  gradient 
vector  [2:154]: 

V{k)  =  first  N  terms  of  {X^{k)E{k)}  (2.70) 

Next,  the  time-domain  gradient  vector  (Equation  2.70)  is  zero  end-padded  with  N  zeros. 
Finally,  the  FDF2  frequency-domain  gradient  vector  V r2{k)  is  calculated  by  transforming 
the  zero  end-padded  time-domain  gradient  vector. 

Applying  the  definition  for  Vp2{k),  the  frequency-domain  weight  vector  update  is 
[2:154] 


li{k  +  l)  =  ll{k)+fi^ 


V{k) 

0 

0 


=  H(/r) -{- /iVp2(^’) 


(2.71) 


where  T  is  the  forward  FFT  operator.  The  FDF2  frequency-domain  gradient  vector 
</th  term  is 

/V-l  2A'-I  2iV-l 

Vn.(A')  =  l/2,'\’  E  E  E 

p=0  r=0  i=N 

.v-l  2A'-I  2A--I  2V-I 

-(1/2A')"E  E  E  E 

p=0  mO  i=A’  71=0 

<1  =  0.  l....,2A' -  1  (2.72) 


where 


(2.73) 


9.09 


The  derivation  of  Equation  2.72  is  a  unique  result  of  this  thesis  and  is  presented  in  .Ap- 
pendi.x  E  along  with  the  V terms  for  the  N  =  2  case.  Comparing  Equations  2. 40  and 
2.72,  the  ^ Fi,(k)  terms  contain  only  the  X‘{h)Xr{lc)llr{k)  product,  where  r  =  0,1, ....  N  — 
1.  The  Vf2,(A')  terms  contain  the  X'{k)Xq{k')Hg{k)  product  as  well  as  X‘{k)Xq{k)Hq{k) 
products;  where  i  =  0, 1, . . .  ,2N  —  1  and  i^q.  Thus,  the  V F2{k)  vector  components  utilize 
more  filtering  information  than  the  V Fi{k)  components.  The  additional  infoimation  present 
in  the  FDF2  gradient  is  essentially  an  average  of  terms  associated  with  each  bin.  Theoreti¬ 
cally  then,  with  a  noisy  input  the  FDF2  taps  should  converge  with  less  adaptation  noise  and 
generally  converge  slower  relative  to  the  FDFl  taps. 

Because  the  EFT  of  a  discrete  time  signal  generates  complex  values,  the  frequency- 
domain  components  of  ll{k),  X{k),  and  E{k),  are  generally  complex. 


FDF2  Tme- domain  Reprc.senlation.  Having  defined  the  FDF2  filter  fre¬ 
quency  domain  operation,  the  equivalent  time-domain  representation  can  now  be  discussed. 
Applying  the  linear  property  of  the  DFT,  the  FDF2  time-domain  weight-update  equation  is 
defined  by  the  inverse  EFT  of  Equation  2.71  [2:152].  This  relationship  requires  the  k  =  0 
frequency-domain  weight  vector,  H(0),  to  be  initialized  to  zero.  The  inverse  EFT  of  Equa¬ 
tion  2.71  provides 


h(A--f  l)  =  h(A-)-h// 


X{k) 

0 


(2.74) 


Thus,  the  gradient  constraint  and  a  requirement  that  the  initial  2.V-lap  weight  vector  l\{k) 
be  initialized  to  all  zeros,  produces  a  2.A’-tap  time-domain  weight  vector  with  the  last  .V 
values  equal  to  zero.  This  result  is  due  to  the  fact  that  a  constant  zero  valued  gradient  is 
add<'d  tt;  the  last  A'  time-domain  taps  on  each  weight  update,  which  effectixeh  results  in  an 
'V  term  time-domain  weight  vector  that  can  be  specified  as 


h(k)  =  [hoik)  /„(/.•)  ...  //A:_.(A-)r 


t  herefore,  the  frequency -domain  versus  time-domain  FDF2  weight  vector  relationship  can 
be  expressed  as  (2:153] 


ii(() = g_^r'') 

A’  zf}o.^ 


(2.76) 
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The  'veiglit-update  equation  for  the  jth  tap  can  be  expressed  as 


hj{k  +  \)  =  hj{k)  +  fiVj{k)  (2.77) 

where  j  =  0. .  .N  ~  1.  Vj(A:)  represents  the  jth  component  of  V(^)  which  was  defined  in 
Equation  2.70.  ^j{k)  is  defined  (2:153) 


N-l 

(2.78) 

«=0 

where  x^n+i  and  ekN+t  represent  the  ith  (f  =  0.  ...,A^  —  1)  component  of  the  klh  N-point 
block  of  the  input  and  error  sequences.  Equation  2.78  shows  the  ^'th  block  gradient  term 
for  each  time-domain  weight  to  be  the  cross-correlation  of  the  erroi  terms  derived  fi'om  each 
block  and  the  filter  input  [2:154]. 

With  the  time-domain  weight  vector  defined,  the  FDF2  time-domain  output  calculation 
can  be  presented.  Since  the  FDF2  filter  processes  blocks  of  data,  the  output  calculation  is 
most  conveniently  represented  using  vector  multiplication.  The  linear  convolution  time- 
domain  output  calculation  for  the  kth  block  is  defined  [2:153] 

y^^■^’+i)  =  h'^{kHk^^  +  i)  f  =  0,1,...,A'-1  ;fc  =  0,l,2,...  (2.79) 

where  represents  the  ith  component  of  y(^•)  (Equation  2.66)  and  h(^)  is  specified  in 

Equation  2.75.  Letting  the  quantity  {kN  -f  i)  represent  a  discrete  time  index,  the  vector 
x^(LnV  -}-  i)  containing  the  N  most  current  input  data  values  at  time  {kN  -f  i)  is  specified  by 

y^{kN  +  i)  =  .-cp-jv+i-i)  (2.80) 

FDF2  Optimum  Weight  Vector.  A  derivation  of  the  optimum  time-domain 
weight  vector  for  the  FDF2  filter  is  identical  to  the  L.\1S  filter  derivation  (Section  2.2.) 
Equations  2.32).  This  is  based  on  the  fact  that  the  FDF2  filler  performs  linear  convolution. 
I’sing  the  result  presented  in  Equation  2.32  and  the  relationship  stated  in  Equation  2.76. 
the  frequency-domain  optimum  weight  vector  Hopi  can  l)e  expressed  as 

=  (2-81) 
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N 

FDF2  Real  Multiplies 

LMS  Real  Multiplies 

4  4.50 

S 

2.875 

16 

1.7-50 

32 

1.031 

64 

0.594 

256 

0.188 

1024 

0.057 

Table  2.2.  FDF2  vs  IWS  Real  Multiplies 


P'DF2  Compulational  Ra/uircnicnii.  A  computational  analysis  reveals  that 
the  FDF2  filter  requires  fewer  multiplies  for  large  filters  than  the  time  domain  adaptive  filter 
[2:154].  The  FDF2  filter  uses  five  2,V-point  FFTs  and  4.V  complex  multiplies  to  produce  .V 
output  data  points. 

A  2A^-point  FFT  can  be  performed  using  an  .V-point  FFT  aiul  .V  complex  multiplies 
[2:154].  Since  an  A'-point  radix-2  FFT  requires  approximately  (A72)log2(A')  -  complex 
multiplies  [2:154].  a  total  of  (5.\72)  log2(.V)  comidex  multiplies  are  required  for  the  five 
FFTs.  Combining  the  FFT  com|)lex  multiplies  and  l.V  complex  multiplies  gives  a  total  of 
(5A/2)  log2( A' )  -r  4.<V  complex  multiplie.s  j)er  .V  output  values  produced. 

The  time-domain  L'  '  filter  require.'.  2A‘  real  multiplies  to  produce  .V  output  point^ 
[2:154].  .Assuming  four  rcai  multiplies  is  equi\alent  to  one  conijrlex  multiply  yields  the 
following  ratio: 

FDF'lReal Multiplies  5log2.A'  -i-S  /•> '0 

LM S Real M till iplics  A'  ~ 

The  computational  savings  is  significant  for  larg<  filteis.  Table  2.2  contains  the  ratio  of  FDF2 
real  multiplies  to  time-domain  L.MS  real  multiplies  versus  .V.  In  (omparison  to  Table  2.1. 
the  ratios  in  Ta!)Ie  2.2  a’e  clearly  larger.  This  make.s  sen.se  due  to  the  fact  that  FI)F2 
requires  lOA  iog2  .V  -f  16.\  real  multi|)iios  per  .\  output  points.  FDFI  conver.sely.  requires 
3.Vlog2{A72)  -f  S.'V  real  multiplie.s. 

2.3  Chaplcr  Sinnutary 

.Several  major  |)oints  prc.sentcd  in  this  chaptei  are  now  summari/.ed  before  procc<-ding 
to  the  next  chapter,  do  Iregin.  the  major  points  j)r<'.sented  concerning  the  f)\VT  were; 


1.  The  Discrete  Walsh  Transform  (DWT)  is  a  real  valued  transform  that  is  implemented 
in  the  same  general  fashion  that  the  Discrete  Fourier  Transform  (DFT)  is  implemented 
(See  Section  2.1.2). 

2.  The  DWT  does  not  have  a  time-shift  property  (See  Section  2.1.3). 

3.  The  inverse  DWT  of  the  product  of  two  A'-point  DWTs  produces  dyadic  convolution 
(See  Section  2.1.4). 

4.  Dyadic  convolution  uses  modulo-2  addition  to  determine  the  recursive  time  shift, 
whereas  linear  convolution  uses  arithmetic  addition. 

5.  Dyadic  correlation  and  convolution  are  identical  since  modulo-2  addition  and  subtrac¬ 
tion  are  equivalent. 

6.  The  DWT  requires  no  multiplications  whereas  the  DFT  requires  complex  multiplies 
for  an  A^-point  transfrom. 

7.  The  real  DWT  matrix  and  the  complex  DFT  matrix  have  similar  symmetry  charac¬ 
teristics. 

8.  Analogous  to  the  DFT,  Fast  Walsh  Transforms  (FWT)  exist  to  exploit  the  DWT 
matrix  symmetry. 

The  implementation  similarity  of  the  DWT  and  DFT  warrants  research  in  applying  the 
DWT  to  existing  frequency-domain  block-piocessing  filtei  designs.  A  circular  convolution 
fiequency-domain  filter  (FDFl)  (See  Section  2. 2. 2.1).  and  the  Fast  LMS  frequency-domain 
filter  (FDF2)  (See  Section  2. 2. 2. 2)  were  examined.  The  next  chapter  presents  two  Walsh- 
domain  filters  that  are  developed  from  the  FDFl  and  FDF2  designs. 
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III.  Walsh-Domain  Filter  Design 


In  Chapter  II,  a  circular  convolution  frequency-domain  filter  (FDFl)  and  a  linear 
convolution  frequency-domain  filter  (FDF2)  were  presented.  In  this  chapter,  the  following 
developments  are  presented: 

1.  Section  3.1  presents  a  W’alsh-domain  extension  of  the  FDFl  filter  design,  Walsh-domain 
Filter  1  (WDFl).  The  filter  performs  dyadic  convolution  and  requires  few'er  multipli¬ 
cation  operations  than  FDFl. 

2.  Section  3.1  also  presents  a  new  algorithm,  the  Walsh  Transform  LMS  algorithm  1 
(WLMSl)  which  provides  a  weight  update  algorithm  for  the  real  valued  WDFl  Walsh- 
domain  tap  weights. 

3.  Section  3.2  presents  a  new  Walsh-domain  filter  design,  Walsh-domain  Filter  2  (WDF2), 
that  is  developed  from  the  FDF2  filter.  The  filter  uses  a  modified  ‘‘overlap-save” 
method  and  requires  fewer  multiplication  operations  than  FDF2. 

3.1  Walsh-Domoin  Filler  1  (WDFl) 

This  section  pie.sents  the  WDFl  filter  which  was  developed  by  extending  the  FDFl 
design  into  the  Walsh-domain.  To  aid  the  reader,  a  discussion  parallel  to  the  FDFl  presen¬ 
tation  in  Section  2.2.2. 1  w'ill  be  used. 

Implementation  of  the  FDFl  design  wdtli  the  DWT  is  a  direct  application  of  Equa¬ 
tions  2.1(i  and  2. IS  from  Section  2.1.4.  The  design  accommodates  the  use  of  the  DWT 
ui.ectly  (Figure  3.1)  with  minor  algorithm  changes  asso\,iated  with  replacing  a  complex 
\  dued  transform  with  a  real  x'alued  transform. 

3.1.1  WDFl  Time-domain  hi'inii  Vector  Dcjhiilion.  WDFl  filter  input  vectors  arc  as 
specified  for  the  FDFl  filter.  Letting  .r,  icpiescnt  the  input  sequence,  the  A’  input  sequence 
values  which  define  the  A’th  input  block  are  represented  by  .r/t/v+,,  where  ?  =  0, 1 , . . . ,  A'  —  1 
and  A-  =  0, 1,2,  —  Using  this  notation,  the  A'th  block  input  vector  is  defined 

x(A-)  =  (.rjt;v  ...  .Tfc/v+A'-i]^  (3.1) 


X 


N'Point 

DWT 


Ih{k) 


Eoik) 


VN-iik) 


EN-iik) 


Doik)  _ Z)a'-,(/c) 


N-Point 

DWT 


Figure  3.1.  VValsh-domain  Adaptive  Filter  1  (WDFl) 
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Similarly,  the  Hh  block  desired  signal  input  vector  is  defined 


d(/r)  =  [djtA/  ...  c/fciv+/V-i]^  (3.2) 

3.1.2  WDFl  Walsh-domain  Input.  Analogous  to  the  FDFl  FFT  input  matrix  (Equa¬ 
tion  2.65,  the  kth  block  input  DWT  matrix  X{k)  is  given  by 

X{k)  =  d2a<7{>V{(a;(|..;v)  •••  a;(tA'+N-i)]}} 

Ao(A-)  0 

Xr{k) 

0  Aa/_,(A-) 

where  W  is  the  forward  DWT  operator.  The  A*th  block  desired  vector  DW^T  components 
define  the  A’th  block  Walsh-domain  desired  vector  D(A:): 

D(A:)  =  W{((/(ji../v)  ...  d(kN+N-i)]} 

Do(A-) 

Ddk) 

Da^-,(A') 

3.1.3  WDFl  Oulpvl  Calculation.  The  transform  components  of  the  A-t  h  input  block, 
X„{k),  are  multiplied  with  the  re.spective  A’th  block  Walsh-domain  filter  weights.  //„(A-).  to 
produce  the  A-th  block  output  spectral  components,  )„(A:): 

Y(A-)  =  X(A-)H(A-)  (;5.5) 

wheie 

H(A-)  =  [//o(A-)  //,(A’)  ...  //A'-,(A')r  (3.6) 

Taking  the  inver.se  DWT  of  Y(A’)  produces  the  Adh  block  output  vector.  Repre.senting  the 
N  output  se(|ucnce  values  as  ?/aa+i;  "'here  i  =  0.1,...,  A'  —  1,  the  Adh  block  time-domain 


output  block  vector  is  defined 


y(^')  =  [?/(/;/V), . . . ,  y{kN+N-i)V 


(3.7) 


and 

y{k)  =  W-^X{k)E{k)]  (3.8) 

The  W~^  operator  used  in  Equation  3.8  is  the  inverse  DWT  operator. 

3.1.4  WDFl  Walsh-domain  Weight  Update.  Following  the  same  procedure  used  with 
the  FDFl  filter,  the  output  spectral  components,  are  subtracted  from  the  correspond¬ 

ing  desired  signal  spectral  components,  D„{k),  to  produce  the  ^:th  block  Walsh-domain  error 
components,  En{k): 

E{k)  =  Dik)  -  Y{k)  (3.9) 

The  En{k)  values  are  used  to  update  the  Walsh-domain  filter  weights. 

Equation  2.45,  which  defines  the  FDFl  frequency-domain  weight  update  algorithm, 
uses  the  conjugate  of  the  input  diagonal  transform  matrix  X{k)  in  calculating  the  frequency- 
domain  gradient.  The  corresponding  VN'alsh-domain  weight  vector  calculation  is  therefore 

n(k  +  l)  =  H{k)  +  pX{k)E{k)  (3.10) 

since  the  Walsh-domain  components  are  real  quantities.  The  vectoi  format  foi  Il(A')  is  spec¬ 
ified  in  Equation  3.6.  Equation  3.10  defines  Walsh  Transform  LMS  algorithm  I  (WLMSl). 
A  literature  search  indicates  that  WLMSl  has  not  previously  been  developed. 

Using  an  approach  similar  to  that  irsed  foi  Equation  2.45,  Equation  3.10  can  be  ex¬ 
pressed  as 


\]{k+\)  =  l-\{k) -k  iiX(k)E{k) 

=  E{k)  H-  ii{X{k)E){k)  -  X{k)X{k)U{k)] 

=  H(A-)-b//V,n(A-) 


(.3.11) 


where  n  is  the  convergence  constant  and  represents  the  Walsh-domain  gradient 

vector  for  WDFl,  i.e. 


o 

t> 

Xo(A:)[i?o(^0  -  Xo{k)Ho{k)] 

^wi{k)  = 

^m,{k) 

= 

X,{k)[Dr{k)-X,{k)H,{k)] 

.  '^wiN-iik]  . 

AVi(A')pAf-i(fc)- AV-i(A:)i/N-i(^-)]  . 

V/ri(A')  and  are  very  similar  (See  Equations  2.46  and  .3.12).  The  two  vectors 

differ  in  that  the  V;rj^(A’)  terms,  where  j  =  0, 1, . . . ,  —  1,  are  generally  comple.x  valued 

whereas  the  terms  are  real  valued. 

For  the  previous  discussion,  in  all  cases,  the  index  n  indicates  the  spectral  component, 
k  indicates  the  block  being  processed,  and  i  is  the  discrete  time  index.  Because  the  DWT 
of  a  discrete  time  signal  results  in  real  values,  the  Walsh-domain  components  H„(k),  En{k), 
Xn{k),  Dnik)^  and  Yn{k)  are  real. 

3.1.5  WDFl  Time-domain  Representation.  In  the  preceding  discussion  it  was  demon¬ 
strated  that  replacement  of  the  FFT  with  the  DWT  in  the  FDFl  design  requires  virtually  no 
change  to  the  transform  domain  equations  presented  for  FDFl  (Section  2.2.2. 1).  The  equiv¬ 
alent  time-domain  equations  for  the  DWT  implementation,  however,  present  a  departure 
from  the  FDFl  time-domain  equations. 

Using  the  relationship 

h{k)  =  W-^li{k)}  (3.13) 

and  the  linear  property  of  the  DWT  (Equation  2.7),  the  inverse  D\\’T  of  Equation  3.10  gives 

h{k-\-\)  =  h{k)-\- pV{k)  (3.14) 


where 

V(A:)  =  W-’{E(A-)X(A')}  (3.15) 

Equations  2.18  and  2.15  state  that  the  inverse  DWT  of  the  product  of  the  two  Walsh-domain 
vectors  E{k)  and  X{k)  is  equivalent  to  the  dyadic  convolution  of  their  time  domain  vectors. 
The  dvadic  convolution  of  the  two  time-domain  vectois  is  analogous  to  the  liucai  (oinolution 


of  these  two  vectors  as  described  in  Equation  2.78.  The  difference  is  the  replacement  of  a 
modulo-2  shift  for  a  linear  addition  derived  shift  and  the  incorporation  of  a  scaling  factor. 
These  modifications  provide 


Vj(k)  =  l/N^  e,(k)n,e„,  j  =  0,h...,N-l  (3.16) 

1=0 

where  j  is  the  time-domain  weight  index,  ©  indicates  modulo-2  addition  for  the  binary 
representations  of  i  and  j,  and  defines  the  A*th  block  gradient  term  for  each  time- 

domain  weight.  The  .r,(A)  and  e,{k)  terms  represent  the  flh  component  of  x(A)  and  e(A) 
respectively,  during  the  Ath  block: 

x(A)  =  [Xkl^  ...  XkN+N-l] 

=  [.To(A)  ...  .T(jv-i)(A)]  (3.17) 


and 


e(^')  =  [CfcN  •••  ei./V+Ar_i) 

=  {{dhN-ykN)  •••  {dkN+N-\  -ykN+N-\)] 

=  [eo(A)  ...  e(/v-i)(A))  (3.18) 

Using  Equation  3.16,  the  Ath  block  weight  update  equation  for  the  jth  tap  is  defined 

A.,(A-}-l)  =  h,{k)  + ixVjik)  (3.19) 

Having  defined  the  time-domain  weight  update  equation,  a  similar  equation  foi  the  out¬ 
put  will  fully  specify  WDFl  in  the  time-domain.  Using  the  same  approach  applied  in  the 
derivation  of  Equation  3.16.  Equation  3.8  can  be  cxpre.s.sed 

!/.(<■)  =  l/.'V  f,  h,^k)x^.^.,|,  /  =  0, 1 . A'  -  1  (3.20) 

1=0 

where  f/,(A)  is  the  ?th  component  of  the  A-th  block  output  vector  y(A). 

Equation  3.20  states  that  y(A)  is  calculated  by  dyadically  convolving  the  time-domain 
taps  and  input  data  values  for  the  Ath  block.  The  time-domain  output  calculation  can  also 


be  represented  in  vector  form.  Letting  the  quantity  {kl\  +  i)  represent  a  discrete  time  index, 
where 


i  = 

k  =  0,1,...  (3.21) 

the  output  sample  at  time  {kN  +  i)  can  be  calculated  using 

t/(,,v+.)  =  il/jy)h^(kN  +  ^MkN  +  0  (3.22) 

The  vectors  x(kA'  +  /)  and  kikjV  +  ?)  are  defined 

x(kA^  +  ?)  =  [.T(A-Af+,')  XlkN+tei)  ■  ■  ■ 

h(kN  +  i)  =  lko(kN  +  i)  ki(kN  +  i)  ...  /q;v-i)(A:tV  +  OF  (3-23) 

where  the  terms  of  x(kA^  +  0  defined  x^kN+t®})-,  j  =  0, 1, . . . ,  -  1,  and  ©  indicates 

modulo-2  addition  for  the  binary  representations  of  {kN  -f-  i)  and  j. 

3.1.6  WDFl  Optimum  Weight  Vector.  The  optimum  time-domain  weight  vector  for 
this  design  will  differ  from  that  presented  in  Section  2.2.1.  due  to  the  fact  that  the  filter 
output  calculations  are  peiformed  using  dyadic  convolution  and  the  autocoi relation  matiix 
terms  aie  calculated  using  dyadic  corielation,  which  is  mathematically  equivalent  to  dyadic 
convolution  (Section  2.1. .5).  The  performance  equation  for  VVDFl  can  be  derived  using  ector 
representations  for  the  output  and  error  calculation.  Having  defined  the  A'th  block  output 
vector  calculation  as  a  vector  multiplication  (Equation  3.20).  it  lemains  to  define  the  error 
calculation  in  a  similar  mannei.  Using  Equation  3.22  and  the  associated  definitions,  the 
error  sample  at  time  {kN  -f-  /)  is  defined 

e(rA--n)  =  <'/(r-A'+.)  -  2/(r-A’+.) 

=  </,»-+, I -(l//V)h'^((-)x(;, ■.%■+,')  (:).24) 

Making  a  change  of  variable  such  that  the  variable??  is  sub'  ii.Med  for  (A';V-f?),  Equation  3.22 
becomes 

(3.2.5) 


?/..  =  {  \ !  N)\\^  [i})x{rt) 


where 


''*'(71®!)  •  •  •  •^’(ti©(/V-l))] 


h(7?)  =  (/io(7?)  hi{n)  ...  /i(;v'-i)(n)]^' 

Similarly,  Equation  3.24  becomes 

^7»  —  dji  X/n 

=  4  -  (1/A^)h^(n)x(n) 


(3.26) 

(3.27) 


(3.28) 


Following  the  hopt  procedure  outlined  in  Section  2.2.1;  substitution  of  Equation  3.28 
into  Equation  2.26  produces 


E\tl]  =  Eidl\  +  (l/A'^)h''7J.h  -  (2/A')fJh 


where  Ru,  is  the  Walsh  autocorrelation  matrix  and  is  defined  as 


(3.29) 


^a:r(0) 

^xx(-l)  . 

..  $xx(-A^+l) 

^rx(l) 

^xx(O) 

..  $«(-A'-b2) 

^xx(2) 

^xx(l)  . 

..  ^>xx(-A'-b3) 

^xx(iV-l) 

$xx(A'-2)  . 

^xx(O) 

(3..30) 


and  <hj.j(i)  =  Pir  i.*^  fhe  Walsh  cross-correlation  vector  and  is  defined  a.s 


Pn.  =  E(«nX(n)]  = 


<h,/x(0) 

<I>.x-(-l) 

^rfr(-A' +  1) 


(.3.31) 


where  ^dxU)  =  P{dn-'<^(nej)]-  ^'nder  the  assumption  that  the  input  signal  and  desired  signal 
are  stationaiy,  /?„.  and  I\  are  constant  and  as  such  require  no  time  subscript.  Equation  3.29 
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is  referred  to  as  the  performance  equation  or  mean-square  erroi  (MSE)  equation  for  the 
WDFl  filter. 


Equation  3.29  chaiacterizes  a  performance  surface  that  the  WDFl  filter  searches  to  find 
a  global  minimum  which  is  guaranteed  to  exist  by  the  quadratic  nature  of  the  equation.  The 
weight  vector  that  satisfies  the  global  minimum  is  referred  to  as  hop(.  Solving  for  hop(  requires 
taking  the  gradient  of  F[e^]  with  respect  to  the  h  vector,  and  setting  the  gradient  equal  to 
the  zero  vector.  Executing  the  same  steps  as  indicated  in  Section  2.2.1,  Equations  2.31  and 
2.32,  yields 

hop,  =  NR-JPu,  (3.32) 

Substituting  Equation  3.32  into  Equation  3.29  for  h  yields 

=  E\4\- Pi RZ'P^  (3.33) 

.Analogous  to  the  time-domain  optimum  weight  vector  result  (Equation  2.32),  Equa¬ 
tions  3.32  and  3.33  show  that  the  WDFl  filter  optimum  weight  vector  is  determined  by 
the  inverse  of  the  input  autocorrelation  matrix  and  the  cross-correlation  vector.  However, 
the  autocorrelation  and  crosscorrelation  terms  for  WDFl  are  actually  dyadic  convolution 
terms  (Section  2.1. .5).  Therefore,  the  dyadic  autocorrelation  input  statistics  and  the  dyadic 
cross-correlation  statistics  of  the  desired  signal  and  input  will  directly  affect  the  optimum 
weight  vector. 

3.1.7  WDFl  Computational  licquircmciits.  A  computational  comparison  can  be  con¬ 
ducted  for  the  WDFl  filler  versus  the  FDFl  filter  in  the  same  manner  as  the  LMS  filter 
was  compared  to  the  FDFl  filter.  The  WDFl  filter  u.ses  three  .V-point  DWTs  to  produce  A 
output  points.  .\o  multij^licat ion  operation.s  are  involved  with  the  DWT.s  since  an  .V-point 
DW'f  can  l>e  implemented  with  no  multiplications  and  .V(.V  -  1)  adds.  2.V  real  multiplies 
are  required  for  weight  update  and  output  (alcuialion.  Therefoie.  the  WDFl  filter  leciuires 
2N  real  multiplies  per  A’  output  points  \eisus  the  rDF'l  rec|uirenient  of  3,V  log2(  A72)  -fSA’. 
The  ratio  of  WDFl  real  multiplies  to  F'DFl  real  multiplies  is 

W DFlRcalMvltii)lic.s  2 

FDFl  Real  Multiplies  ""  31og2(.A72)  -f  8  ’’  ^ 


Table  3.1  contains  the  ratio  of  VVDFl  to  FDFl  real  multiplies  for  various  A^-point  block 
sizes.  Clearly,  the  WDFl  filtci  pre.sents  a  computational  savings  in  terms  of  multiplications. 


N 

WDFl  Real  Multiplies 

FDFl  Real  Multiplies 

4 

0.180 

8 

0.143 

16 

0.118 

32 

0.100 

64 

0.087 

256 

0.069 

1024 

0.0-57 

Table  3.1.  VVDFl  vs  FDFl  Real  Multiplies 


3.2  Walsh-Domain  Filter  2  (WDF2) 

This  section  presents  the  VVrF2  filter  which  was  developed  by  extending  the  FDF2 
design  into  the  VValsh-domain.  To  aid  the  reader,  a  discussion  parallel  to  the  FDF2  presen¬ 
tation  in  .Section  2. 2. 2. 2  will  be  used. 

Unlike  the  FDFl  filter,  the  FDF2  filter  design  is  not  suitable  for  use  with  the  DWT. 
Figure  3.2  shows  a  block  diagram  of  the  final  VVDF2  configuiation.  .A  comparison  with 
Figure  2.1  reveals  a  distinct  difference  in  that  the  \VDF2  filter  does  not  use  a  Gradient 
Constraint.  The  Gradient  Constraint  was  incompatible  with  the  DWT  and  the  reasons  for 
that  will  l)c  pre.scnted  in  Section  3.2.-!. 

3.2.1  W'DF2  Time-domain  Input  Vector  Definition.  Like  the  FDF2  filter.  \\‘DF2  pro- 
cessc's  the  current  and  pievious  input  blocks  to  produce  the  current  output  block,  do  facili¬ 
tate  reader  undei standing,  the  nutation  pre.sented  for  the  FDF2  filtei  will  (igain  be  presented 
at  this  tiiiK'.  Using  the  notation  r,  to  represent  the  input  seciucnce.  the  .V  input  secjuence 

values  which  define  the  Ath  input  block  are  repre.sented  by  .r<..,v+i,  where  /  =  0. 1 . .A’  —  1. 

Referring  to  Figure  3.2.  the  hih  block  input  vector  \{k)  is  composed  of  the  concatenated 
N-point  previous  block  and  N  point  current  block,  which  defines  a  .50%  overlap  of  the  k  -  1 
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and  k  N-point  blocks.  Therefore,  the  kih  block  input  vector  is  defined 


x(/.-)  =  [.r(A-A'_A')  •••  •T(;.-A'+A'-1))'^ 


(3.35) 


{k-l)th  block 


kth  block 


The  kih  block  desired  vector  d(A')  follows  the  VVDFl  definition  (Equation  3.2). 

3.2.2  WDF2  Walsh-domain  Input.  The  A-th  block  DVVT  2N x2N  input  matrix  X(A') 
is  specified  using  the  DWT  equivalent  of  Equation  2.65.  In  this  case,  the  A-th  block  input 
vector  transform  components  define  the  diagonal  components  of  the  A-th  block  input  DWT 
matrix  .X(A-); 


X(A-)  =  (//«</{  W[.r(A.A;-.V)  ...  •T(A-A--I)  J‘(A;V)  ■<'(A-.V+A-1)]  } 

{k-l)th  block  kth  block 

'  A'o(A-)  0 

X,{k) 

0  X2N-l{k) 


(3.36) 


where  W  is  the  forward  DWT  operator. 

3.2.3  \\  DF2  Output  Calculation.  The  A-th  block  outj)u(  vector  (y(A-))  is  determined 

using  the  DWT  equivalent  of  Equation  2.66: 


y(^')  -  [.'/(A,V): - .'/(A;V+A--I))’ 

=  last  A-  Icnvs  of  W'  {X(A-)H(A  )}  (3.37) 

where 

ll(A-)  =  (//o(A-)  //,(A-)  ...  //>a_.(A)]''’  (3.38) 

The  FDF2  filter  retains  the  last  A’  values  of  the  inverse  transfoim  result  because  they  are 
equal  to  the  values  produced  by  the  linear  convolution  sum  (.see  .Section  2. 2. 2.2).  In  Equa¬ 
tion  3.37  the  product  .X(A-)1I(A-)  defines  the  dyadic  convolution  of  the  a.ssoriated  time-domain 
vectors  for  X(A-)  and  II(A-).  'rherefore.  .saving  the  last  A’,  or  any  A'-point  combination  of  the 
2.V  values  produced,  will  not  accomplish  linear  convolution.  'I'he  choice  of  which  output 
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samples  to  retain  is  then  unclear.  For  this  thesis,  the  last  .V  values  were  chosen  as  the 
output,  which  is  stated  in  Equation  3.37. 

3.2.jj  WDF2  Walsli-doinaiu  Weight  Update.  The  FDF2  implementation  was  dis¬ 
cussed  in  Section  2. 2. 2.2  and  it  was  mentioned  that  the  gradient  constraint  section  of  Fig¬ 
ure  2.4  was  necessarj  to  ensure  lineai  convolution.  Section  2.1.4  presented  the  fact  that 
the  inverse  Walsh  Tiansforrn  of  the  product  of  two  .V-point  W’alsh-transforms  is  equivalent 
to  the  dyadic  convolution  of  their  time-domain  sequences  (Equation  2.18).  Therefore,  the 
WDF2  filter  will  perform  dyadic  convolution  whether  the  Gradient  Constraint  procedure  is 
executed  or  not.  As  a  result,  using  or  not  using  the  procedure  fundamentally  becomes  a 
weight  update  issue. 

The  equations  pertaining  to  the  Gradient  Constraint  procedure  from  Section  2. 2.2. 2. 
replacing  the  F FT  with  DWT,  are  as  follows: 


E(A')  =  W { [p  .  y  0.  (f/(/..,v)  -  y{hi\’))  ■  ■  ■  (d^kN+N-i)  -  ] 


(3.39) 


A’  zeros 


kth  error  block 


V(h)  =  first  .V  terms  of  {X'{k)E{k)}  (3.40) 


H(/.--i-  1)  =  H(A-)-f//>V 


V(k) 

0 


(3.41) 


where  W  rcpre.scnls  the  DWT  operator. 

In  cxediling  (he  last  step  of  the  W'alsh-domain  gradient  calculation,  as  indicated  by 
the  vector  transform  in  Eriuatioi.  3.11.  a  zeio  end-padded  \ector  is  traiisfoimeil  using  the 
DW'T.  Since  the  vectoi  is  end  padded  with  .V  zeros,  the  resulting  2.V  term  Walsh  domain 
gradient  vectoi  is  component  symmetric  (.Settion  2.1. 2.1).  .\.s  a  result  of  the  (omi)onent 
symmetric  gradient  vector,  the  Il(/.’)  vector  will  be  component  .symmetric.  Cleaily  then,  the 
filter  spectral  bin  taps  are  not  going  to  converge  independently.  Therefore,  the  Gradient 
Constraint  structuie  of  Figure  2.1  is  incompatible  with  a  DWT  ba.sed  \ersion  of  FDF2. 
Eliminating  the  30%  ‘‘over  lap  .save"  method,  which  incoriioratcs  the  Gradient  Const i aim, 
produces  a  filter  e(|uivalent  to  W'DFl.  Howerer.  eliminating  the  Gradient  (^)nstraint  and 
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Figure  3.2.  Walsh  .Adaptive  Filter  2  {WI)F2) 


retaining  the  oOh  over  lap  charactciisli<  j)re.sent.s  a  design  unique  with  rc.spect  to  the  WDFi 
filter. 

Removing  the  Gradient  Constraint  block  from  the  dcn^igii  leave.*,  a  Walsh  domain  gt.. 
dicnt  vector  that  is  identical  in  terms  of  calculation  to  that  which  appears  in  Ftpiation  3.10; 

11(/.-  4-  1 )  =  H(A-)  -r  //.\(/.  )l-:f/.  )  (3.12) 

where  the  .X(A').  h{/:).  and  H(A')  vector  components  are  r<*al  valued  quantities.  The  prodiul 
\{lc)E(k-)  defines  the  W  1)F2  Walsh-domain  gradient  vector  X'ljjf/.-).  ComparativeK.  the 
\\  DFl  vector  V»  i(A  )  and  W  DI  ‘2  vectoi  Vjj  2(A’)  are  uni<iue .since  E(A-)  for  the  WDF2  filter  is 
derived  from  th<*  /.cro  front  padded  Ath  block  error  vector  (see  Fquation  3.30).  [C({uation  3. 12 
will  be  referred  to  as  Waksh  Transform  L.\1S  algorithm  2  (WIAIS2).  .\  literature*  search 
indicates  that  \\  bMS2  ha.s  lu-ver  been  cieveloped  previously. 


Using  Equations  3.39,  3.37,  and  3.36  the  VValsh-domain  WDF2  gradient  vector  for 
N  >  2  is  defined 

^\V2o{b) 

Vu/2,(^) 

Vw2{k)  =  :  (3.43) 

^H'22^._2(A’) 

.  '^»'22A-_i(^0  . 

Xo(A:)[^iVo(A:)  -  Xo{k)Ho{k)  +  Xrik)H,{k)] 

X^{k)[-DN,{k)  +  Xo{k)Ho{k)  -  X,{k)H,{k)] 

X2ik)[-DM,{k)  -  X2{k)H2{k)  +  X3{k)H3{k)] 

X^{k)[D^,{k)  +  X2ik)H2{k)  -  X4k)Hs{k)] 

=  1/2  i 

X[2.N-.\){k)[D!\’^._^{k)  -  X(2N-4){k)H{2N-4){k)  +  A'’(2A'_3)(^')^:f(2/V-3)(^')] 
A(2A'-3)(^')[~^A'n-2(^')  +  X(2N-4){k)H{2N-4}{k)  —  X{2N -3){k)  11  {2N -■■i]{k)] 
X(2N-2){k)[  —  D^’i^_^{k)  -  X^2N--2){k)H^2N-2){k)  +  X^2N-l){k)H^2N-l){k)] 
X{2N-\){k)[D^r^._^{k)  +  X{2N~2){k)H{2N-2){k)  “  A(2/V-l)(A')//(2A'-l)(fc)] 

where  the  Z)a'„(A')  terms  repiesent  the  ?7.th  component  of  the  N-point  DW’T  of  the  cunent 
N-point  block  of  the  desired  signal.  For  N  =  2.  X\y2(k)  can  be  expressed  as 


’  V,r2„(A-)  ■ 

Xo{k){(l[2i;)  +  d(2t+i)  “  ~Xo(k)Ho{k)  +  2Ai(/r)//i (A')j 

Vw2,(A-) 

=  1/4 

A'i(A-)[-r/(2A-)  -  fWi)  +  2Xo{k)Ho{k)  -  2X,ik)HAk)] 

A^1V22(A') 

X2{k)[—(l(2k}  +  d(2A.+i)  —  2X2{k)H2{k)  +  2X3{k)H3{k)] 

_  Vii/23(A-) 

A3(A:)(d(2Ao  -  V.+1)  +  2A'2(A-)7/2(fc)  -  2A3(AU/73(A-)] 

Equations  3.43  and  3.44  are  derived  in  Appendix  E. 


Comparing  Equations  3.12  and  3.43,  the  '^W2j{k)  terms  contain  and 

X(j+i'i{k)H^j+i'j{k)  products,  where  j  =  0, 2, 4, . . . , 2A''  -  2.  Conversely,  the  X\yi^[k)  terms 
contain  only  the  Xj{k)Hj{k)  product,  where  j  =  0,  l,...,iV  -  1.  The  terms  are  distinct 
because  a  different  E{k)  is  used  for  WDF2  (See  Equations  3.39  and  2.44).  This  relationship 
is  somewhat  analogous  to  the  associated  FDFl  and  FDF2  transform-domain  gradient  vector 
comparison. 

The  Xw2j{k)  components  are  distinctly  different  from  the  X p2j{k)  components.  The 
X F2j{k)  components,  aside  from  being  generally  complex  valued,  contain  multiple  product 
terms  (See  example  in  Appendix  E)  whereas  the  X[\:2j{k)  components  contain  two  prod¬ 
uct  terms.  Thus,  the  removal  of  the  Gradient  Constraint  procedure  reduces  the  avei  aging 
exhibited  in  the  X P2ik)  vector  components  to  two  terms  for  the  X\y2{k)  components. 

3.2.5  WDF2  Time-domain  Representation.  Having  defined  the  Walsh-domain  struc¬ 
tures  of  WDF2,  the  time-domain  representation  of  this  filter  can  now  be  addressed.  The 
time-domain  weight-update  algorithm  is  derived  from  the  inverse  DWT  of  Equation  3.42. 
laking  the  inverse  DWT  of  the  product  E{k)X{k)  yields  the  time-domain  dyadic  convolution 
result  of  the  two  vectors 

x{k)  =  [x{kN-N)  ^(kN+N-i)]]  (3.45) 

' - V - '  ' - V - ' 

{k-\)th  block  ^thblock 

e{k)  -  [P  ...  0,  {d{k.\')  -  y{kN))  ■■■  {<^{kN+N-i)  -  y{kN+N-i))]'^  (3.46) 

^  ^  -  -  V 

N  zeros  ,,  , 

ktn  error  block 


The  dyadic  convolution  result  defines  the  time-domain  WDF2  gradient  vector  X{k).  The 
jth  component  of  X{k)  is  defined 

X,{k)  =  l/2/v'^'(,(A-)x,,e,)(A-),  i  =  0.1....,2A'  -  1  (3.47) 

1=0 


w’here  j  is  the  time-domain  weight  index,  0  indicates  modulo-2  addition  foi  the  binary 
representations  of  i  and  j,  and  V^(A-)  defines  the  A'th  block  gradient  term  foi  each  time- 
domain  weight.  The  .r,{k)  and  e,(k)  leims  represent  the  Ah  component  of  x(A’)  and  o{k) 


respectively,  during  the  ^:th  block: 


x{k)  —  [x^hN-N)  X^hN)  •••  X(kN+N-\)] 


{k—l)th  block 

=  [xo{k)  ...  X^2N-l)ik)] 


kth  block 


(3.48) 


and 


e{k)  -  (P  ■  ■  ■  0,  (d(/;yv)  -  J/(fc;V))  .  ■  •  {(l^kN+N-l)  -  J/(fcA'+A'-l))F 

^  ^ - — - V - ' 

zeros  ,,  , 

kin  error  block 

=  [eo(^‘)  •••  e(2jV-i)(A')]^  (3.49) 

Using  Equation  3.47,  the  time-domain  weight  update  equation  can  be  specified 

h,{k  +  l)  =  hj{k)-\-nV,{k)  (3.50) 

The  time-domain  weight  index  j  now  spans  2N  taps  as  opposed  to  the  FDF2  case  of  N  taps, 
because  the  gradient  constraint  was  eliminated.  For  a  block  size  of  N  input  data  values,  the 
WDF2  filter  has  a  time-domain  equivalent  filter  with  2.V  taps  as  opposed  to  the  FDF2  filter 
which  has  N  time-domain  equivalent  taps.  The  number  of  output  values  remains  N. 

The  time-domain  equivalent  of  Equation  3.37  determined  using  the  relationships 
stated  in  Equations  2.18  and  2.15  from  Section  2.1.4.  Equation  2.18  states  that  the  inverse 
DWT  of  the  product  X{k)}\{k)  yields  the  dyadic  convolution  of  the  associated  time-domain 
vectors  x{k)  and  h{k).  The  dyadic  convolution  sum  for  the  2A''-point  kth  block  input  vector 
x{k)  and  time-domain  tap  vector  h(A’)  is  given  by 


2/V-l 

y,ik)  =  1/2N  Y.  /U(4r(,ej)(/^-).  ?  =  0. 1 . 2.^^  -  1  (.3.51) 

j=o 

where  .i\{k)  is  the  ith  component  of  x{k)  (see  Equation  3.48).  and  @  indicates  modulo- 
2  addition  for  the  binary  representations  of  i  and  j.  'fhe  last  N  sample.s  of  this  result 
represent  the  values  f/(AA-+j)-  where  j  =  0, . . . ,  jV  -  1.  and  k  is  the  block  index.  Therefore, 
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the  WDF2  kth  block  output  can  be  expressed  as 

2A'-1 

!,,(<■)  =  1/2A'  Y:  *,(<-•)»'((,+«)«,)(*:).  i  =  0, 1, ....  A'  -  1  (3.52) 

J=0 

where  ?/,(A')  represents  the  ?th  component  of  y{k)  such  that 


y{^)  =  b(fcyV)  •••  y{kN+N-i)]'^ 

—  (j/o(^‘)  y{N~\){k)]'^  (3.53) 

The  output  calculation  in  vector  form  can  be  expressed  as 

2/(,a-+.-)  =  h^'(A-A'  +  0x(A:A^  -  A^  +  f)  j  =  0,  L . . . ,  W  -  1  (3.54) 

where 

x{kN  -  N  +  i)  =  {x(^kN-N)  ^(kN-N+l)  •••  ^{kN+N-l)]^  (3.55) 

and  h{k)  is  specified  as 

h(/rA^  + /)  =  [/i(,+jV)(A-)  /i{(n.A')®i)(^’)  •••  /'(('+A')@(2A'-i)(^')]^  (3.56) 


In  comparison,  both  WDFl  and  WDF2  A’th  block  output  vectors  are  determined  from 
the  dyadic  convolution  of  x(A-)  and  h(A').  The  distinction  between  \VDF2  and  W’DFl  output 
calculation,  aside  from  input  vector  and  tap  vector  length,  is  that  only  the  last  A'  values  of  the 
\VDF2  dyadic  convolution  result  are  saved  as  the  N  output  \ allies  for  the  A’th  block  whereas 
the  .'V-poinI  WDFl  dyadic  convolution  result  repre.sents  that  fillers  A’th  block  output.  In 
both  ca.ses  the  time-domain  weight  vector  is  the  .same  size  as  the  inj)ut  vector. 

S.'-2.0  \\'DF2  Opliinvm  Weight  Vector.  Given  that  the  output  values  are  derived  from 

the  dyadic  convolution  of  the  input  and  time-domain  weight  vector  in  both  cases,  the  WDF2 
.MSE  equation  is  the  same  as  that  produced  for  WDFl  (Equation  3.29)  with  the  constant 
term  changed  from  S  to  2A’  o  .'’count  for  the  fact  that  the  WDF2  filter  is  convolving  2N 


size  vectors. 


Replacing  the  N  term  in  Equation  3.29  with  2N,  j'ields  the  following  VVDF2  MSE 
equation 

=  £(<1  +  -  (1/W)p;ii  (3.57) 

where  the  matrix  Riu  and  the  vector  are  as  specified  in  Section  3.1,  Equations  3.30  and 
3.31.  Applying  the  optimum  weight  vector  derivation  procedure  outlined  in  Section  2.2.1, 
the  optimum  time-domain  weight  vector  for  \'VDF2  is 

Kr,i  =  WR-JP,.  (3.58) 

Substituting  Equation  3.58  into  Equation  3.57  for  h  yields 

U.  =  E{dl\-PlK'P,  (3.5!)) 

which  is  the  same  result  that  was  derived  for  WDFl  (Equation  3.33).  Theoretically  this 
is  a  reasonable  result  given  that  the  optimum  time-domain  weight  vectors  differ  only  by  a 
factor  of  2.  Equations  3.58  and  3.59  show  that  the  VVDF2  filter  optimum  weight  vector  is 
determined  by  the  inverse  of  the  input  dyadic  autocorrelation  matrix  and  the  dyadic  cross¬ 
correlation  vector.  Therefore,  as  in  the  ca.se  of  the  WDFl  filter,  the  dyadic  autocorrelation 
input  statistics  and  the  dyadic  cross-correlation  statistics  of  the  desired  signal  and  input 
determine  the  optimum  weight  vector. 

3.2.'/  WDF2  Compiitalional  Requirements.  .A  computational  compaiison  can  be  con¬ 
ducted  for  the  WDF2  filter  versus  the  FDF2  filter  in  the  same  manner  as  the  LMS  filtei 
versus  the  FDF2  filter.  The  WDF2  filter  uses  three  2A'’-point  DWTs  to  produce  A'  output 
points  each  requiring  no  multiplications  since  a  2.'V-point  DWT  can  simpl\  be  implemented 
with  2.V(2.'V  —  1)  adds.  lA'  real  multiplies  are  required  for  weight  update  and  output  calcu¬ 
lation.  Therefore,  the  WDF2  filtei  requires  -lA'  real  multiplies  pei  .V  out|)ut  points  versus 
the  F1)F2  requirement  of  lO.V  logjlA'^)  4-  16A\  The  ratio  of  \VDF2  real  multiplies  to  FDF2 
real  multiplies  is 

WDF2RcalMnltipHcs  _  2 

FDF2  Real  Multiplies  5  log2(A') -f  8 

Table  3.2  summarizes  the  computational  savings  related  to  multiplications. 
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N 

WDF2  Real  Multiplies 

FDF2  Real  Multiplies 

4 

0.111 

8 

0.086 

16 

0.071 

32 

0.061 

64 

0.053 

256 

0.042 

1024 

0.034 

Table  3.2.  \VDF2  vs  FDF2  Real  Multiplies 


2.S  Chapter  Smiimary 

Two  adaptive  Walsh-domain  filters  were  developed  by  extending  the  FDFl  and  FDF2 
filter  designs  into  the  Walsh-domain.  The  important  developments  presented  are  as  follows; 

1.  The  FDFl  filter  supports  using  the  DWT  with  no  modification  to  the  design.  This 
implementation  was  termed  Walsh-domain  filter  1  (WDFl)  (See  Section  3.1). 

2.  The  gradient  constraint  portion  of  the  FDF2  design  is  incompatible  with  the  DWT. 
Removal  of  the  gradient  constraint  does  result  in  a  DWT  compatible  design.  This 
implementation  was  termed  Walsh-domain  Filter  2  (WDF2)  (See  Section  3.2). 

3.  The  WDFl  and  WDF2  Walsh-domain  weight  update  equations  (WLMSl  and  WLMS2) 
are  based  on  the  complex  LMS  algorithm  and  they  are  very  similar  but  distinct. 

4.  The  dyadic  autocorrelation  input  statistics  and  the  dyadic  cro.ss-correlation  and  au¬ 
tocorrelation  statistics  of  the  desiied  signal  and  input  determine  the  optimum  weight 
vector  for  WDFl  and  WDF2. 

b.  A  Walsh-domain  LMS  algorithm  was  developed  for  the  first  time  in  this  thesis. 

The  next  chapter  discusses  the  implementation  and  verification  of  WDFl  and  WDF2  soflw,ire 
implementations. 
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IV.  Filter  Verification 


4-1  IntrodxLction 

The  previous  chapter  presented  a  theoretical  analj’sis  of  two  Walsh-clomain  adaptive 
filters;  designated  VVDFl  and  WDF2.  The  next  step  is  to  iin])lement  the  filters  in  software 
and  then  verify  the  software  implementations.  Therefore,  there  are  three  major  goals  for 
this  chapter  which  are  presented  in  the  remainder  of  this  section. 

1.  The  equations  and  algorithms  implemented  in  the  WDFl  software  are  defined  (Sec¬ 
tions  4.2.3  and  4.2.2). 

2.  The  equations  and  algorithms  implemented  in  the  WDF2  software  are  defined  (Sec¬ 
tion  4.2.4  and  4.2.2). 

3.  The  WDFl  and  VVDF2  filters  are  tested  for  errors  (Sections  4. 2. 3. 2,  4. 2. 4. 2,  and  4.3). 

4.2  Sofhuare  Algorithm  Identification  And  Testing. 

This  section  is  intended  to  familiarize  the  reader  with  the  WDFl  and  WDF2  software 
and  associated  algorithms.  This  section  also  discusses  the  specific  test  used  to  verify  each 
filter  and  the  results  of  the  test.  brief  discussion  concerning  two  filters  used  in  this  thesis 
for  comparison  purposes  is  also  pre.sented. 

4.2.1  Comparison  Filters.  This  thesis  utilizes  a  time-domain  LMS  adaptive  filtei  and 
a  frequency-domain  block- processing  filter  in  Chapter  \’  to  evaluate  relative  peiformance 
measures  for  the  WDFl  and  WDF2  filters.  The  time-domain  LMS  adaptive  filtei  will  be 
referred  to  as  the  TDF  filter  throughout  the  remainder  of  this  thesis.  The  TDF  filter  is  a 
single-input  adaptive  transversal  filter  (Section  2.2.1)  with  a  variable  filter  size.  The  r''l)F2 
filter  (Section  3.2)  is  used  as  a  ba.seline  for  comparison.  'I'his  filter  uses  a  radi.\-2  IT'T. 
Thioughout  the  remaindei  of  this  thesis,  this  filter  will  be  referred  to  as  the  FDF  filtei. 

4.2.2  Gain  Con.‘>tant  Calcvlalion.  There  are  several  methods  for  calculating  a  gain 
constant  ft  based  on  the  filter  proccsssing  domain.  Gain  constant  for  the  TDF  filter  is  defined 
as 

.1 1  iso dj  usi  men  I  M 

^  .\'(SigvalFu(r(j!i)  .\’-F,  .rf 


(■1.1) 


where  N  represents  the  number  of  filter  taps  and  x,  is  a  stationaiy  signal  [3:3-6].  Misad- 
justnienl  is  defined  as  “...a  measure  of  how  closely  the  adaptive  process  tracks  the  true 
Weiner  solution  . . .  [3:3-6].  A  larger  M  value  results  in  a  larger  n  value  and  produces  faster 

adaptation  but  at  a  cost  of  greater  adaptation  noise. 

There  are  two  methods  of  calculating  the  gain  constant,  /f,  for  the  block  processing 
filters.  The  first  uses  the  average  power  in  each  spectral  bin.  For  the  WDFl  and  WDr"2 
filters,  the  7?th  bin  gain  constant,  //„,  is  calculated  as  follows 


Misadjusiment 


(4.2) 


where  P6,„„(A-)  =  Xl{k),  k  represents  the  A-th  block,  and  Xn{k)  represents  the  i7lh  diagonal 
component  of  the  input  transform  matrix  X(A').  In  the  case  of  the  FDF  filter,  the  spectral 
bins  and  their  respective  filter  weights  are  complex.  Therefore,  the  FDF  filter  utilizes  an 
independant  fi  for  the  real  and  imaginary  parts  of  the  bin.  Calculation  of  /irca/  ^ind 
the  real  and  imaginary  gain  constants  respectively,  using  Equation  4.2  is  accomplished  by 
replacing  Pbin„{k)  with  P6i»jrea(„(A')  and  Pbinimag„{f^')  respectively. 


The  second  calculates  a  constant  (.i  common  to  all  of  the  spectral  bins.  This  method 
calculates  the  average  power  in  each  bin  with  respect  to  the  block  index  k,  Pbm„i  and  averages 
the  Pb,n„  values  to  produce  Pbmavg-  For  the  WDFl  and  WDF2  filters,  the  gain  constant  is 
calculated  as  follows 


/'  = 


Misadjusiment 


bxnavtj 


(4.3) 


where 


Pbmavg  ~  ^  hi  ^  .  Pbm, 
1=0 


(4.4) 


and  7/  repre.sents  the  number  of  spectral  bins  (2X  for  WDh'2  and  N  for  WDFl).  In  the  ca.se 
of  FDF2,  the  average  of  the  sum  (T  all  the  real  and  imaginary  bin  component  powers  is  u.sed 
to  calculate  Pbmavg 

i;-I 

^  bmavg  —  1/4 A'  ^^{Pbmrral,  +  Pbi  nimagt  ) 

1=0 

where  the  1/lA'  constant  accounts  for  the  2N’  real  bins  and  2N'  imaginary  bins. 


(•1.5) 


4-2.3  WDFl  Filler  The  WDFl  program  implements  the  equations  developed  in  the 
previous  chapter.  In  performing  the  DWT  and  inverse  DVVT,  the  program  implement.^  the 
direct  form  of  Equations  2.3,  2.1,  and  2.4. 

4-2.3. 1  WDFl  Software  Overview  The  WDFl  software  flow  is  as  follows: 

•  Initialize  variables,  arrays,  and  vectors 

•  Load  input  signal  and  desired  signal 

•  Calculate  the  number  of  A’-point  blocks  in  the  input 

•  Calculate  // 

•  Loop  Slai't:  Create  the  A'-point  current  block  input  vector 

•  Calculate  the  Walsh-domain  N  by  N  diagonal  input  matrix  X(A-) 

•  Calculate  the  Walsh-domain  A^-point  desired  block  input  vector  D{k) 

•  Calculate  the  A^-point  output  block  vector  y{k) 

•  Calculate  the  Walsh-domain  Af-point  error  vector  E(A') 

•  Calculate  the  Walsh-domain  A'^-point  Gradient  vector 

•  Update  the  A^-point  Walsh-domain  weight  vector  using  WLM.S1 

•  Loop  to  Loop  Start  if  more  blocks 

4-2. 3. 2  WDFl  Filter  Verification  Te-M  This  test  verifies  the  WDFl  filter  which 
includes  Walsh  Transform  LMS  algorithm  1  (WLMSl).  The  test  input  signal  used  is  derived 
from  summing  the  columns  of  the  Walsh  8  b\  S  (Ws)  transform  matrix  (See  Appendix  A), 
and  periodically  repeating  the  resultant  .sequence.  Summing  the  columns  of  \\  .,  prodmes  an 
S-point  sequence  of 

.Tt  ={8  0  0  0  0  0  0  0}  (1.6) 

with  a  corresponding  DWT  of 

AT  =  {1  1  1  1  1  1  1  1}  (4.7) 

The  seciuence  exprc.s.sed  in  E(|uation  4.6,  with  the  filtei  configured  to  process  8-point  blocks, 
is  the  ini)Ul  \<ctoi  \[l)  foi  ilie  klh  block  |)roce.ss(‘d.  The  desiied  input  signal  is  produced 


by  first  multiplying  each  row  of  W’a  by  a  different  constant.  The  resulting  modified  W’s 
matrix  columns  are  then  summed,  producing  an  S-point  sequence,  which  is  then  repeated 
periodically.  Utilizing  the  coefficients  listed  in  Table  4.1  produces  the  8-point  sequence 

4  =  {18.15  -  6.85  -  2.934  -  0.984  0.411  -5.607  1.033  6.652}  (4.8) 

with  a  corresponding  DVVT  of 

=  (1.2341  0.6116  3.5123  0.2921  4.8234  1.9142  2.8314  2.9311}  (4.9) 

The  sequence  expressed  in  Equation  4.8,  with  the  filter  configured  to  process  8-point  blocks, 
is  the  desired  vector  d(/:)  for  the  A:th  block  processed.  Since  the  input  spectral  components 
for  each  block  processed  all  have  a  magnitude  of  1  (Equation  4.7)  and  the  corresponding 
desired  block  spectral  components  (Equation  4.9)  are  constant  from  block  to  block,  the 
corresponding  tap  '  alues  for  each  bin  should  theoretically  converge  to  the  desired  spectral 
component  values.  The  input  and  desired  signal  are  depicted  in  Figure  4.3. 

Configuring  the  WDFl  filter  as  specified  in  Table  4.2,  the  VVDFl  output  error  is 
depicted  in  Figure  4.4.  Figures  4.9  thru  4.16  depict  the  adaptation  tracks  for  the  bin  taps. 
Clearly,  the  figures  show  that  WLMSl  is  a  valid  Walsh-domain  weight-update  equation.  All 
of  the  data  in  the  figures  and  tables  presented  foi  this  test  were  produced  using  a  contant  /t 
value  for  the  bin  taps.  The  results  using  an  independantl,\  derived  /<  value  foi  each  bin  tap 
were  identical  and  the  figuies  and  tables  presented  foi  this  test  aie  representative  of  those 
results.  Table  4.3  displays  the  theoretical  and  experimental  tap  values  for  the  VVDFl  filler. 


Table  4.1.  \'erifiration  Test  coefficients 


Table 


^lablo  1.3. 


Parameter 

Setting 

Block  Size 

Mi.sa(ljustnient 

0.2 

Data.size 

1000 

■1.2.  Verification  Test  WDFl  filter  settings 
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Figure  4.1.  The  DWT  of  one  period  of  the  Input  Signal 
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Figure  4.2.  The  DWT  of  one  period  of  I  he  De.sired  Signal 
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Figure  4.3.  VVDFl  Verification  Test  Input  Signals 
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4.2.4  \VDF2  Filter  The  \YDF2  program  implements  the  equations  developed  in  Sec¬ 
tion  3.2  of  the  previous  chapter.  ,\s  with  the  WDFl  program,  the  DWT  and  inverse  D\\  T 
transforms  are  performed  using  Fquations  2.3.  2.1.  and  2.4. 

4.2.4.  J  \VDF2  Software  Overview  The  \VDF2  softv.-are  flow  is  as  follows: 

•  Initialize  variables,  arrays,  and  vectors 

•  Load  input  signal  and  desired  signal 

•  Calculate  the  number  of  A'-poini  blocks  in  the  input 

•  Calculate  // 

•  Loop  .Start:  Create  the  2.-V-point  i)ast-current  block  input  vector 

•  Calculate  the  VValsh-domain  2;V  In-  2.V  diagonal  input  matrix  .X(A-) 

•  Calculate  the  A'-point  output  block  vector  y{h) 

•  Calculate  the  VValsh-domain  2.V-point  error  vector  E(l:) 

•  Calculate  the  VValsh-domain  2 A'- point  Gradient  vector 

•  Update  the  2.'V-point  VValsh-domain  weight  vector  using  VVL.MS2 

•  Loop  to  Loop  .Start  if  more  blocks 

.{.2.4.2  \\  l)F2  Filter  Vcnjication  This  te.st  verifles  the  W  1)F2  filter  software 

which  includes  Walsh  Transform  L.MS  algoiithm  2  (WL.\1S2).  The  .signal  set  used  to  verify 
the  VVDFl  filter  is  also  used  to  verify  the  \VDF2  filter.  .Since  the  WDF2  rdtei  utilizes  the 
concatenated  current  and  previous  input  data  blocks  to  e.aluate  the  curr-mt  block  .V  output 
values,  the  input  vector,  e.xcluding  the  first  block  proces.sed.  i.s  given  by 

x(A-)  =  {8  0  0  0  0  0  0  '»  S  0  0  U  0  0  0  0}  (-I.IO) 


with  a  corresponding  DWT  of 


A'„  =  {  1.23-1  0  0  0.612  3..=’)12  0  0  0.202  -1.823  0  0  1.911  2.831  0  0  2.9311  (-1.11? 


I  'J 


The  2jV- point  DVVT,  withjV  =  8,  of  the  desired  sequence  specified  by  Equation  4.8  for  each 
block  is 


d{k)  {18.15  -  6.85  -  2.934  -  0.984  0.411  -  5.607  1.033  6.652 

18.15  -  6.85  -  2.934  -  0.984  0.411  -  5.607  1.033  6.652}  (4.12) 

with  a  corresponding  DWT  of 

A.  =  (1.234  0  0  0.612  3.512  0  0  0.292  4.823  0  0  1.914  2.831  0  0  2.931}  (4.13) 

The  ’nput  vector  and  desired  vector  Walsh  spectrums  are  illustrated  in  Figure  4.5  and 
4.6.  The  figure...  show  that  the  zero  valued  components  are  identical  in  number  and  occur 
in  the  same  index  positions.  The  nonzero  valued  components  for  each  input  block  are  of 
magnitude  1  and  therefore  the  corresponding  taps  for  each  bin  should  theoretically  converge 
to  the  desired  bin  spectral  magnitudes. 


Figure  4.5.  The  16-poin(  DWT  of  two  periods  of  (he  Input  Signal 


Configuring  the  WDF2  filter  as  specified  in  Table  4.2.  the  WDF2  output  error  is 
depicted  in  Figure  4.8.  Table  4.4  display.^  the  theoretical  and  experimental  tap  values  for 
the  WDF2  filter  tap.s.  The  results  displaced  in  the  figures  and  tables  were  produced  using 
a  v.(-nstant  ft  value  for  the  bin  taps.  4'hc  previous  input  block  for  the  initial  current  input 
block  was  initialized  to  zero. 

Figure  4.7  depicts  the  DWT  of  the  initial  input  vector  processed  by  the  filter.  As 
Figure  1.7  shows,  the  initial  VWdsh-dcmain  input  spectrum  is  such  that  there  are  no  zero 
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<J  £  Cl. 


Figure  4.6.  The  16-point  DWT  of  two  periods  of  the  Desired  Signal 


Figure  4.7.  The  16-point  DWT  of  the  initial  input  vector 
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Figure  4.8.  WDF2  Filter  Verification  Test  Output  Error. 


components.  After  the  first  block  {k  =  0),  the  bin  positions  1,2,5,6,9,8,13,  and  14  become 
zero.  The  bin  taps  in  those  positions  update  after  the  first  block  is  processed  and  then 
freeze  because  their  corresponding  inputs  are  zero  value  thereafter.  Figures  4.17  thru  4.32 
illustrate  the  adaptation  tracks  for  each  of  the  bins  utilizing  a  constant  f.i  value.  Table  4.4 
contains  the  experimental  versus  theoretical  tap  value  results  derived  using  a  constant  n 
value  for  the  bin  taps.  Initializing  the  previous  input  block  to  the  sequence  specified  in 
Equation  4.6  produces  the  spectrum  in  Figure  4.5.  With  the  initial  previous  input  ve^-tor 
initialized  in  this  fashion,  the  experimental  tap  values  correspond  exactly  to  the  theoretical 
values. 

Alternatively,  using  an  independantly  derived  //  value  for  each  bin  tap,  and  ignoring 
the  first  block  the  filter  processes  when  accessing  the  average  power  in  each  bin,  produces 
experimental  tap  values  that  are  equal  to  the  theoretical  values.  The  first  previous  block, 
when  initialized  to  zero,  generally  produces  a  block  spectrum  that  is  unique  with  respect  to 
succeeding  block  sivectrums.  Since  the  initial  block  is  generally  unique  it  can  be  considered 
an  anomaly  and  therefore  ignored.  The  tables  and  figures  displayed  for  this  test  are  othei  wise 
representative  of  the  results  obtained  when  using  a  different  /i  value  foi  each  bin  tap.  Clearly, 
the  figures  and  tap  adaptation  results  show  that  WLiMS2  is  a  valid  Walsh-domain  weight- 
update  equation. 


Tap 

Theoretical 

Experimental 

0 

1.2.34 

1.234 

1 

0 

0.123 

2 

0 

0.061 

3 

0.612 

0.612 

4 

3.512 

3.512 

5 

0 

0.351 

6 

0 

0.029 

■1 

0.292 

0.292 

8 

4.823 

4.823 

9 

0 

0.482 

10 

0 

0.191 

11 

1.914 

1.914 

12 

2.831 

2.831 

13 

0 

0.283 

14 

0 

0.293 

15 

2.931 

2.931 

Table  4.4.  WDF2  Verification  Test  Experimental  Results 
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Figure  4.10.  VVDFl  H\{k)  .Adaptation  Track 


Figure  4.11.  VVDFl  //2(/c)  Adaptation  Track 
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Figure  4.15.  WDFl  He{k)  Adaptation  Track 
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Figure  4.16.  VVDFl  Hjik)  .Adaptation  Track 
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Figure  4.18.  VVDF2  Hi{k)  .Adaptation  Track 


Figure  4.20.  \VDF2  Ihih)  Adaptation  'IVack 
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Figure  4.22.  VVDF2  Ih,{k)  .Adaplalion  Track 
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O-  c  ^ 


Figure  4.23.  WDF2  lh{k)  Adaptation  Track 


Figure  4.24.  \VDF2  ll-;{k)  Adaptation  Track 


Figure  4.30.  \VDF2  //i.-}(Ar)  .Adaptation  Track 
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Figure  4.32.  WDF2  Adapt.A.tion  Track 


Jf.S  Filter  Verification  Test  S 

Tliis  section  addresses  a  test  that  was  used  to  validate  the  TDF  and  FDF  software. 
*his  test  was  also  used  on  the  VVDFl  and  WDF2  filters  and  the  results  are  discussed. 

The  FDF  and  TDF  filters  were  tested  using  the  filters  in  a  forward  modeling  configura¬ 
tion  Figure  4.33).  The  input  is  zero-mean  unit-variance  i\  !ditive  White  Gaussian  Noise 
(N'(0,1)).  The  desired  signal  is  the  N(O.I)  noise  passed  through  the  plant  (a  four  tap  digital 
FIR  filter).  Utilizing  the  Z-transform.  the  theoretical  transfer  function  of  the  adaptive  filters 
after  convergence  is  given  oy  (10) 

II{^\  ^X(f( )  /.  I 


//(-)  = 


(4.14) 


where  is  the  Cross-power  spectrum  of  the  desired  signal  and  input  signal  and  4>rx(~) 

is  the  Auto  power  spectrum  of  the  input  signal.  Representing  the  z-transform  of  the  plant 
transfei  function  by  //,,(;);  the  the  Cross-power  spectrum  can  be  expre-ssed  as  (lOj 


<I>x,;(-)  =  //,.(-^)4>xx(c) 


(4.15) 


The  .\uto-power  .spectrum.  <I>xj-(c).  in  this  case  is  one  because  the  input  i.s  N'(O.i)  noise  (lOj. 
Utilizing  this  fact  and  Equations  1.14  and  4.15,  the  transfer  function  of  the  adaptive  filters 
is  determined  by 

^^p(“)  ^  I  t  in\ 


11{Z)  = 


(4.16) 


Equation  1.16  stales  that  the  transfer  functions  of  the  adaptive  filters  should  theoretically  be 
equal  to  the  plant  transfer  function.  In  other  words,  the  filter  tap  v.eight.s  should  conwige 
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Figure  4.33.  Verification  Test  2  Configuration 


Jap 

Case  / 

Case  2 

ho 

6.123 

6.123 

hi 

0 

1.127 

hi 

0 

1.346 

hz 

0 

4.001 

Tabic  4.5.  Forward  Modelling  Te.sl:P!ant  tap  valuc.c  for  Ca.se  1  and  C'-.sc  2 


to  the  plant  FIR  filter  tap  weights.  In  the  FDF  case,  this  means  that  the  inverse  FFT  of  the 
frec|uency-domain  bin  taps,  after  they  have  converged,  should  be  equi\alenl  to  the  plant  FIR 
filter  tap  weights.  'I’wo  sets  of  tap  wcight.s  were  used  for  the  plant  FIR  in  ihi.s  te.st  (Table  4.5). 
The  first  was  a  trivial  ca.se  (Sec  Table  4.5  Casr  J );  the  Iiq  tap  to  6.123  aii<i  the  remaining 
three  to  zero.  This  configuration  simply  scale.s  the  .\(0.1)  signal  by  a  factor  of  0.12.  The 
FDF  filter  wa.s  configured  to  process  5  point  blocks,  which  means  the  filter  w.-u.  using  S- point 
FF'I's  and,  accordingly  had  8  frequency-domain  taps.  The  8  frequenc\  dinnain  taps  inverse 
transform  to  an  equivalent  I  tap  time  domain  FIR  filter  via  the  gradient  constraint  userl  in 
the  FI)F2  design. 

For  Case  I.  the  TDF  taps  converged  to  (6.123  0  0  Oj.  The  inverse  FFT  of  the 
FDF  frequency  domain  laps,  after  conveigiMue.  produced  the  .same  result.  In  Ca.se  2.  the 
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time-domain  tap  weights  for  both  filters  achieved  the  plant  solution.  In  both  cases,  a  niisad- 
justmenl  value  of  M  =  0.1  was  used  and  the  FDF  filter  used  a  constant  /r  value.  The  FDF 
filter  failed  to  converge  to  the  theoretical  tap  values  when  a  separate  /r  for  each  frequency 
bin  was  used. 

The  forward  modelling  test  was  also  used  to  verify  the  WDFl  and  WDF2  filters. 
Both  filters  were  configured  to  process  4-point  blocks,  using  4  and  8  Walsh-domain  taps  for 
the  WDFl  and  WDF2  filters  respectively.  The  equivalent  time-domain  "'yadic  convolution 
filter  for  WDFl  has  4  taps  and  8  taps  for  the  WDF2  filter,  because  WDF2  doesn’t  use  a 
gradient  constraint.  Neither  filter  was  expected  to  achieve  the  plant  values  because  both 
filters  perform  dj'adic  convolution.  In  this  case,  the  N(0,1)  input  and  the  plant  filtered 
version  of  the  N(0,1)  signal  serve  as  a  nonperiodic  input  and  desired  signal  pair. 

Using  the  tap  values  for  Case  1,  and  a  Misadjustment  of  M  =  0.1,  all  of  the  Walsh- 
domain  tap  values  converged  to  6.123  for  the  WDFl  and  WDF2  filters.  Both  the  independant 
and  constant  bin  calculations  produced  the  same  result.  This  matches  the  theoretical  ex¬ 
pectation.  N(0,1)  noise  produces  an  N-point  DWT  composed  of  all  N  sequency  functions 
used  in  the  transform.  The  DWT  is  a  linear  transform  (Section  2.1.2),  so  the  scaling  per¬ 
formed  by  the  Plant  results  in  a  scaled  version  of  the  input  signal  transform  for  the  desired 
signal.  Accordingly,  the  W'alsh-domain  bin  weights  should  all  converge  to  the  scaling  factor 
of  6.123. 

For  Case  2  and  M  =  0.1;  neither  WDFl  or  WDF2  were  able  to  filter  the  N(0,1)  noise 
to  produce  the  Plant  output.  This  was  true  for  both  an  independant  and  constant  bin  //.  For 
both  filters,  the  Walsh  tap  adaptation  tracks  were  excessively  noisy  and,  with  the  exception 
of  the  zero  sequency  bin  tap,  failed  to  converge.  Figures  4.34  thru  4.39  show  the  adaptation 
tracks  for  the  W'DF2  filter  bin  taps  Ho{k),  H5{k),  and  H2{k):  as  well  as  the  respective  input 
signal  transfoim  component  to  desired  signal  transform  component  ratios.  These  three  bin 
taps  leprcsent  best,  typical,  and  worst  case  in  terms  of  adaptation  noi.se  present. 

.A.S  the  figures  show,  tap  //o(A-)  has  the  least  amount  of  adaptation  noise.  Comparing 
the  bin  ratios  for  the  three  taps  (Figures  4.35,  4.37,  and  1.39)  clearly  shows  that  the 
adaptation  noise  for  each  tap  is  proportional  to  the  variation  in  the  bin  ratio,  where  the  ?ith 
bin  ratio  is  defined 

= W) 

where  k  represents  the  block  index  and  k  =  0,1, —  The  perturbation  in  Figure  4,37  at 
approximately  k  =  110  is  due  to  a  very  small  £>5(110)  value.  'I'he  ratio  variation  is  due 
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to  the  fact  that  the  filtered  noise  is  also  Gaussian  hut  uncorrelated  with  the  N(0,1)  input, 
so  the  resulting  spectrums  from  block  to  block  will  differ  between  input  and  desired.  The 
tap  adaptation  tracks  and  bin  ratios  shown  for  the  WDF2  filter  are  representative  of  results 
produced  by  the  WDFl  filter. 


Figure  4.34'.  WDF2  filter  tap  Ho{k):  Ho{k)  adaptation  track  for  noise  input  and  filtered 
noise  desired  signal  using  constant  bin  n  and  Af  =  0.1, 


Figure  4.35.  WDF2  Ratioo{k).  This  is  the  ratio  of  the  noise  input  8-point  DWT  bin  0  and 
the  filtered  noise  desired  signal  8-point  DWT  bin  0  versus  k. 
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Figure  4.36.  WDF2  filter  tap  Hs{k):  Hs{k)  adaptation  track  for  noise  input  and  filtered 
noise  desired  signal  using  constant  bin  n  and  M  =  0. 1 . 


Figure  4.37.  \VDF2  Ratio5{k).  This  is  the  ratio  of  the  noise  input  8-point  DWT  bin  5  and 
the  filtered  noise  desired  signal  8-point  DWT  bin  .5  versus  k. 
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Figure  4.38.  WDF2  filter  tap  H2{k):  H2{k)  adaptation  track  for  noise  input  and  filtered 
noise  desired  signal  using  constant  bin  yu  and  M  =  0.1. 


Figure  4.39.  WDF2  Raiio2{k).  This  is  the  ratio  of  the  noise  input  8-point  DWT  oin  2  and 
the  filtered  noise  desired  signal  8-point  DWT  bin  2  versus  k. 
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JiJf  Single  Tap  Time- domain  Filter  Test 


The  result  of  X'erification  Test  2  (See  Section  4.3)  prompted  the  testing  of  a  single 
tap  time-domain  filter.  The  hypothesis  is  that  the  dynamics  of  a  single  ‘^ap  time-domain 
LMS  filter  (See  Equation  2.34)  are  an  effective  model  of  the  dynamics  of  »i.e  WDFl  and 
WDF2  real  bin  taps.  This  hypothesis  is  important  because  it  provides  some  n  ^asure  of 
predictability  for  the  WDFl  and  WDF2  filtering  performance.  Figure  4.40  shows  the  test 
configuration.  A'(0, 1)  noise  is  filtered  by  a  single  tap  Infinite  Impulse  Respon.se  (HR)  filter 
and  a  constant  is  added  to  the  result. 

The  purpose  of  the  noise  filtering  procedure  is  to  create  a  signal  with  a  slowly  varying 
random  envelope.  The  resultant  signal  serves  ds  the  input  signal,  .c,  (See  Figure  4.41).  to  a 
single  tap  time-domain  adaptive  LMS  filter.  The  desired  signal  is  a  constant  and  the  gain 
constant  was  /<  =  0.01.  Figure  4.42  shows  the  ho{i)  tap  adaptation  track  versus  the  discrete 
time  index  i  and  Figure  4.43  show's  the  desired  signal  to  input  signal  ratio,  RatiodJi),  versus 
i.  Clearly,  the  adaptation  track  of  the  filter  tap  is  characteristic  of  the  noiselike  variation  of 
Ratiodx{i)-  This  result  is  similar  to  the  plots  presented  in  Section  4.3  and  therefore  supports 
the  hypothesis  of  this  test. 


Figure  4.41.  Single  Tap  Time-domain  Filter  Test:  ,t,.  This  is  the  filtered  noise  input. 


o 

m  ^ 

!  ‘ 

I  V 

-1 

u 

d  -2 

e 

—"i 

_ L _ _] _ 1 _ 1 _ 1 _ 1 _ I _ J  _  _  _ 

( 

100  200  300  400  -500  600  700  800  900 

Time  Ind'',':.  i 

Figure  4.42.  Single  Tap  Time-domain  Filter  lest:  /?o(0-  T'lds  is  the  ho{i)  adaptation  track 
versus  i. 


Figure  4.43.  Single  Tap  Time-domain  Filter  Test:  Ratiojrii)-  This  is  the  ratio  of  the 
desired  constant  to  the  filtered  noise  input  signal  versus  i. 
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4-5  Chapter  Summary 


The  main  purpose  of  this  chapter  was  to  verify  the  WDFl  and  \\’DF2  software  in. pie- 
mentations.  Two  tests  were  used. 

The  first  test  used  a  periodic  input  and  desired  signal  (See  Sections  4. 2. 3.2  and  4. 2. 4. 2). 
The  input  DWT  for  each  block  consisted  of  components  that  were  all  equal  to  1.  The 
desired  DWT  for  each  block  consisted  of  distinct  magnitude  nonzero  components.  In  filtering 
the  input,  the  Walsh-domain  taps  for  both  filters  converged  to  the  corresponding  desired 
transform  component  values,  i.e.  the  theoretical  solution. 

The  second  test  validated  the  TDF  and  FDF  filters,  which  are  used  for  comparison 
purposes  in  this  thesis  (See  Section  4.3).  This  test  used  N(0,1)  noise  as  the  input  signal 
and  a  Plant-filtered  version  of  the  signal  as  the  desired.  Theoretically,  the  TDF  and  FDF 
filter  time-domain  impulse  responses  should  converge  to  the  Plant  tap  values,  given  that  the 
Plant  was  a  4  tap  FIR  filter.  In  both  c^lses  the  experimental  results  matched  the  theoretical 
prediction. 

The  last  test  was  also  used  on  the  WDFl  and  WDF2  filters  as  a  nonperiodic  signal 
test  (See  Section  4.3).  Both  the  WDFl  and  WDF2  filters  perform  dyadic  convolution  and 
inerefore  were  not  expected  to  achieve  the  impulse  response  of  the  Plant,  which  neither  did. 
Two  FIR  filter  cases  were  used.  The  first  was  a  trival  case,  with  only  the  ho  tap  nonzero 
the  Walsh-domain  taps  were  expected  to  converge  to  ho-  Since  the  DWT  of  N(0,1)  noise 
produces  a  DWT  with  a  nonzero  sj^ectral  component  at  every  position,  and  the  desired 
spectrum  for  this  case  is  an  ho  scaled  version  of  the  input.  Experimentally,  both  filters 
achieved  the  theoretical  solution. 

For  the  second  case,  all  four  FIR  taps  were  nonzero  (See  Section  4.3).  Experimentally 
the  WDFl  and  WDF2  filters  were  unable  to  filter  the  input  to  produce  the  desired  signal.  .An 
analysis  of  I  he  bin  tap  adaptation  tracks  showed  excessive  adaptat  ion  noise  that  coi  responded 
with  the  amount  of  fluctuation  that  exists  in  the  ratio  of  the  corresponding  input  transfoiin 
bin  to  the  desired  transform  bin  from  block  to  block.  This  prompted  a  single  tap  time- 
domain  filter  test  (See  Section  4.4).  This  test  was  not  compichensive  but  clearly  indicated 
that  the  adaptation  dynamics  of  the  WDFl  and  WDF2  Walsh-domain  taps  can  be  geneially 
modeled  by  l..e  adaptation  dynamics  of  a  single  tap  time-domain  filter. 

In  summai},  the  tests  in  this  chapter  verified  the  software  implementations  of  the 
WDFl  and  WDr''2  filters.  The  second  test  did  expose  a  |)ossiblc  filtering  limitation,  the 
Walsh  domain  tap  adaptat  ion  t.acks  ire  disrupted  by  tiansform  <  omponent  latio  fluctuatituis 

4-29 


between  corresponding  input  and  desired  DWT  components.  The  next  chapter  presents  the 
time-shifted  sinusoidal  and  rectangular  signal  tests  used  to  establish  the  filtering  performance 
of  the  Walsh-domain  filters  relative  to  each  other  and  the  TDF  and  FDF  filters. 
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V.  Filter  Testing  and  Comparison 


5. 1  Introduction 

The  previous  chapter  discussed  the  software  implementation  and  verification  of  two 
Walsh-dom<.i'i  adaptive  filters:  WDFl  and  VVDF2.  Now  that  software  verification  has  been 
accomplished,  a  relative  measure  of  performance  must  be  established  between  WDFl  and 
WDF2.  Also,  a  relative  measure  of  performance  must  be  established  between  the  two  Walsh- 
domain  filters  and  other  adaptive  filters.  Therefore,  there  are  two  major  goals: 

1.  The  WDFl,  WDF2,  TDF,  and  FDF  filters  are  compared  in  terms  of  convergence  speed 
and  output  error  using  time-shifted  noiseless  and  noisy  periodic  signals  (Section  5.2). 

2.  .A  processing  speed  performance  comparison  is  made  between  the  WDF1,WDF2,  TDF, 
and  FDF  filters.  (Section  5.3). 

5.2  Time-shifted  Signal  Tests 

The  purpose  of  this  section  is  to  investigate  the  effects  of  the  DWT’s  lack  of  time-shift 
invariance  (Section  2.1.3)  on  the  filtering  abilities  of  the  WDFl  and  WDF2  filters.  Four 
signal  tests  are  used  to  conduct  the  investigation: 

1.  Signal  Test  1  (Section  5.2.1)  uses  a  noiseless  periodic  rectangular  signal  as  the  input 
signal. 

2.  Signal  Test  2  (Section  5.2.2)  uses  a  noisy  periodic  rectangular  signal  as  the  input  signal. 

3.  Signal  Test  3  (Section  5.2.3)  uses  a  noiseless  periodic  sinusoidal  signal  as  the  input 
signal. 

4.  Signal  Test  4  (Section  5.2.4)  uses  a  noisy  periodic  sinusoidal  signal  as  the  input  signal. 

For  each  of  the  two  periodic  signals,  input  and  desired  are  derived  from  the  same  signal 
and  the  signal  period  is  16  data  points.  For  the  noiseless  case,  the  input  is  shifted  relative 
to  the  desired  signal.  For  the  noisy  case.  Additive  White  Gaussian  Noise  (N(0,1))  is  added 
to  the  shifted  or  unshifted  signal  to  create  the  input.  Progiessive  input  sample  shifts  are 
used  for  each  case  with  a  4  sample  shift  relative  to  the  desired  signal  being  the  maximum. 
In  each  test,  the  signal  set  is  filtered  by  the  WDFl,  WDF2.  TDF,  and  the  FDF  filters.  The 
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TDF  filter  uses  16  taps  while  the  WDFl,  WDF2,  and  FDF  filters  use  a  16-point  block  size 
{N  =  16).  For  periodic  signals,  seU’ng  N  equal  to  the  period  of  the  signal  results  in  the 
same  input  spectrum  for  each  block  processed.  The  filters  are  then  compared  in  terms  of 
their  convergence  speed  and  the  amount  of  error  between  the  filter  output  and  the  desired 
signal  tor  the  last  6  blocks  processed,  which  would  be  96  output  samples. 

The  number  of  weight  updates  required  to  achieve  10%  of  the  normalized  mean-square- 
error  (NMSE)  serves  cis  the  criteria  for  the  convergence  speed  comparison.  MSB  learning 
curves  for  signal  tests  1  and  3,  are  derived  by  squaring  the  output  error.  The  MSB  learning 
curves  for  signal  tests  2  and  4  are  derived  using  100  data  files  with  the  noise  components 
uncorrelated  between  files  and  the  ensemble  noise  components  being  N(U,1)  samples.  The 
MSB  learning  curves  for  all  4  signal  tests  are  normalized  by  the  desired  signal  power. 

5.S.1  Signal  Test  1  This  test  evaluates  the  WDFl  and  WDF2  discontinuous  signal 
filtering  performance  relative  to  the  TDF  and  FDF  filters.  A  rectangular  signal  is  used  as  a 
simple  discontinuous  signal  representative.  The  hypothesis  is  that  the  Walsh-domain  filters 
will  converge  faster  and  produce  less  error  filtering  rectangular  signals  than  the  FDF  and 
TDF  filters  and  that  shifting  the  input  will  degrade  the  Walsh-filter  performance.  There  are 
two  attributes  of  the  DWT  which  suggest  this  hypothesis: 

1.  The  DWT  of  a  discontinuous  signal  produces  fewer  spectral  terms  than  the  correspond¬ 
ing  DFT  spectrum  (See  .Section  2. 1.2.2). 

2.  The  DWT  spectrum  is  not  time-shift  invariant  (See  Section  2.1.3). 

The  input  signal  used  in  the  test  is  depicted  in  Figure  5.1.  This  signal  functions  as 
the  input  and  desired  signal  in  this  test.  A  992  sample  datasize  is  used  because  it  produces 
an  integer  number  of  16-point  blocks,  as  oppo.sed  to  a  datasize  of  1000  which  does  not. 
The  input  signal  was  time  shifted  to  assess  time  shift  affects  on  filter  erroi  performance  and 
con\ergencc  speed.  An  incremental  shift  of  1  sainj)le  is  made  on  each  filter  run  leiatix  e  to  the 
desired  signal,  with  a  maximum  relative  shift  of  4  samples.  For  the  remainder  of  this  test, 
the  input  signal  for  an  n-point  relative  shift  is  designated  the  n  -  shi ft  input.  Filter  output 
results  for  the  1  —  shi  ft,  3  —  shift,  and  4  —  shi  ft  input  are  pre.sented  as  they  represent  best, 
typical,  and  worst  case,  in  that  order. 
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5. 2. 1. 1  Noiseless  1  —  shift  Results.  The  1  —  shift  signal  pair  is  depicted  in 
Figure  5.2.  The  filter  configuration  used  for  all  4  filters  is  specified  in  Table  5.1.  Figures  5.3, 
5.4.  5.5,  and  5.6  show  the  error  for  the  last  96  output  samples  produced  by  each  filter. 
Clearly,  the  Walsh-domain  filters  produce  less  error  than  the  FDF  and  TDF  filters  for  the 
1  —  shift  input.  The  two  Walsh  domain  filters  produce  zero  error  for  the  last  96  output 
samples. 
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Figure  5.2.  Signal  Test  1:  I  -  shift  filter  inputs.  This  is  the  noiseless  1  -  shift  rectangular 
input  and  de.sircd  signal. 


{  Parameter 

Setting  j 

1  Block  Size 

16! 

1  .Misadjustment 

0.0.5  1 

1  Datasizc 

992 

Tabic  5.1.  Signal  Tes*  1:1—  .</»;//  input  filter  settings 


Figure  5.3.  Signal  Test  1:  WDFl  iter  output  error  for  1  —  shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =  0.5. 
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Figure  5.5.  Signal  Test  1;  TDF  filter  output  error  for  1  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.5. 
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Figure  5.6.  Signal  Test  1;  FDF  filter  output  error  for  1  —  shift  input.  This  is  the  FDF2 
filter  output  error  for  the  last  96  output  samples  using  M  =  0.5. 


5. 2. 1.2  Noiseless  3  —  shift  Results.  The  3  —  shift  signal  pair  is  depicted  in 
Figure  5.7.  The  filter  configuration  used  for  all  4  filters  is  specified  in  Table  5.2.  Figures  5.8, 
5.9,  5.10,  and  5.11  show  the  error  for  the  last  96  output  samples  produced  by  each  filter. 
Clearly,  the  Walsh-domain  filter  output  error  is  less  than  the  TDF  and  FDF  filters  for  the 
3  —  shift  input.  The  WDFl  and  WDF2  3  —  shift  output  error  is  greater  than  the  1  —  shi ft 
result. 


Figure  5.7.  Signal  Test  1:  Z  — shift  filter  inputs.  This  is  the  noiseless  Z- shi  ft  rectangular 
input  and  desired  signal. 


Parameter 
-  Block  Size 
Misadjustment 
Datasize 


Setting 

W 

0.1 

992 


Table  5.2.  Signal  Test  1:3-  shift  input  filter  settings 
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Figure  5.8.  Signal  Test  1:  WDFl  filter  output  error  for  3  -  shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.9.  Signal  Test  1:  WDF2  filter  output  error  For  3- shift  input.  This  is  the  WDF2 
output  error  for  the  leist  96  output  samples  using  M  =  0.1. 
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Figure  5.10.  Signal  Test  1:  TDF  filter  output  error  for  3  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.11.  Signal  Test  1:  FDF  filter  output  error  for  3  -  shift  input.  This  is  the  FDF 
filter  output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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5.2. 1.3  Noiseless  4  —  shift  Resv’ts.  The  4  —  shift  signal  pair  is  depicted  in 
Figure  5.12.  The  filter  configuration  used  for  all  4  filters  is  specified  in  Table  5.3  while 
Figures  5.13,  5.14,  5.15,  and  5.16  show  the  error  produced  for  the  last  96  output  samples. 
Figures  5.13  and  5.14  show  that  the  Walsh-domain  filters  were  unable  to  fdtei  the  4  —  shi ft 
input. 


Time  Index,  i 


Figure  5.12.  Signal  Test  1:  4 -s/ii/t  filter  inputs.  This  is  the  noiseless  4- s/if/t  rectangular 
input  and  desired  signal. 


Parameter 

Setting 

Block  Size 

16 

N'lisadjustment 

0.1 

Datasize 

992 

Table  5.3.  Signal  Test  1:4-  shift  filter  settings 
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Figure  5.13.  Signal  Test  1:  WDFl  filter  output  error  for  i  —  shi ft  input.  This  figure  depicts 
the  WDFl  output  error  for  the  Icist  96  output  samples  using  M  =  0.1. 


Figure  5.14.  Signal  Test  1:  WDF2  filter  output  error  for  4  —  shift  input.  This  is  the  WDF2 
output  error  for  the  l^Lst  96  output  samples  using  M  =  O.i. 
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Figure  5.16  Signal  Test,  1:  FDF  filter  output  error  for  4  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  I'rJ  =  0.1. 


5.2. l.J,  Signal  Test  1  .Analysis.  For  each  of  the  signal  sets  in  Signal  Test  1, 
the  three  block  processing  filters  performed  optimally  using  a  constant  p  value,  in  terms  of 
minimizing  the  error  over  the  last  9G  samples  of  the  992  point  data  set.  Using  an  independent 
p  value  for  each  bin  slowed  the  convergence  speed  of  the  filters  relative  to  using  a  co!.-:ta,nt 

fi. 

Le.ss  error  occurs  for  <i  constant  p  due  to  the  fact  that  Pb,navg  (See  Section  4.2.2)  is 
less  than  the  values.  Therefore,  the  independant  bin  gain  !>«t?nts,  /4„,  arc  less  than 
the  constant  p.  The  vV<dsh-domain  filters'  convergence  speed  decreased  as  the  reference 
shift  incre;ised.  The  TDF  and  FDF  filters,  however,  prodtreed  output  that  was  essentially 
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M 


Shift 


Error  Signal  Power  (Watts) 


TDF 

FDF 

WDFl 

WDF2 

j||ny 

1 

iiilHBMia 

3.48F;  -  01 

0 

0 

2 

5.04F:  -  02 

0 

0 

0.1 

3 

wnaomikM 

b.4bE  -  02 

1.18F;-04 

1.31F;  -  04 

4 

l.dlif  -03 

5.44JF  -  0? 

25 

25 

Table  5.4.  Signal  Test  l:Error  signal  power  for  the  last  9 samples. 


in  'aviant  to  the  sample  si  ii't.  The  Walsh-domain  filters  co  verge  more  slowly  as  the  .shift 
increases  because  the  input  spectrum  components  become  i  ,reasingly  distinct  with  respect 
to  the  desired  signal  spectrum  (See  Section  A. .3). 

Error  Performance.  For  the  1  —  shift  and  2  —  shi ft  inputs,  the  WDFl 
and  WDF2  filters  were  able  to  produce  an  output  that  exactlj  matched  the  desired  signal 
(Figures  5.3  and  5.4).  Conversely,  the  FDF  and  TDF  filters  were  still  converging  at  the  end 
of  the  data  set  with  the  TDF  filter  converging  more  rapidly  (Figures  5.5  and  5.6).  Table  5.1 
specifies  the  filter  configuration.  The  FDF  filter  converged  more  slowly  because  the  input 
frequency  spectrum  is  more  complex'  than  the  sequency  spectrum. 

Table  5.4  contains  the  ormalized  error  signal  power  for  each  hlter.  generated  from  the 
last  96  error  samples  produ  ed  in  each  of  the  four  cases.  Compaiui ively.  for  the  first  three 
sample  shifts,  the  Walsh-domain  filters’  error  performances  were  identie.f  For  the  1  —  shift 
input,  the  TDF  filter  performed  slightly  better  than  the  FDF  filter  while  the  WDFl  ■'nd 
WDF2  filters  were  unable  to  filter  the  4-sample  shifted  rectangular  signal  as  Figures  '.  ■  1 
and  5.13  show.  This  is  due  to  the  fact  that  (he  Walsh-domain  spectrums  for  the  inpu:  c  nd 
<!  jsired  are  zero  magnitude  with  the  exception  of  one  component.  The  sj^ectral  value  for  the 
!  .out  is  not  located  in  the  same  sequency  bin  as  the  desired. 

Convergence  Speed  Compari.^on.  The  results  of  signal  test  1  are  summa¬ 
rized  in  Tai'le  5.5  in  terms  of  the  number  of  weight  updates  required  to  converge.  This 
table  shov  s  in  general  that  the  blockprocessing  filters  require  fewer  weight  updatco  for  this 
test.  With  the  exception  of  the  4  —  shift  input,  the  W'alsh-domain  filters  also  required  the 
least  number  of  weight  updates.  The  Walsh  domain  filter  entries  for  the  4  —  shift  input 
are  indicated  in  the  table  as  “dne";  indicating  “did  not  converge’’.  Clearly,  the  W'DFl  and 
WDF2  performances  were  equivalent. 
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M 

Shift 

Number  of  Weight  Updates 

TDF 

FDF 

WDFl 

WDF2 

0.05 

1 

297 

37 

2 

3 

0.05 

2 

320 

40 

6 

6 

0.1 

3 

168 

21 

11 

12 

0.1 

4 

168 

21 

dne 

dne 

Table  5.5.  Signal  IrNumberof  weight  updates  to  converge. 


Parameter 

Setting 

Block  Size 

16 

Misadjustment 

0.05 

Datasize 

992 

Table  5  6.  S'.^.al  Test  2:  0  —  sin  ft  filter  settings. 

5.2.2  Signal  Test  2  Signal  test  2  is  an  extension  of  Signal  Test  1  (See  Section  5.2.1) 
and  evaluates  the  WDFl  and  WDF2  noisy  rectangular  signal  filtering  performance  relative 
to  the  TDF  and  FDF  filters.  The  WDFl  and  WDr2  filter  error  should  increaise  significantly, 
relative  to  the  Signal  Test  1  results,  based  on  the  testing  accomplished  in  Sections  4.3  and 
4.4.  The  input  signal  used  in  the  test  is  the  sign;il  in  Figure  5.1  with  noise  added.  This 
signal  serves  as  the  input  and  desired  .signal  in  this  test.  The  filter  input  is  simply  a  shifted 
version  of  the  desired  signal.  The  maximum  shift  was  1  samples.  For  the  remainder  of  this 
test,  the  input  .signal  for  an  n-point  relative  shift  is  designated  the  n  —  shift  input.  Filter 
output  results  are  presented  for  the  0  —  shift,  3  —  shift,  and  4  —  shi ft  input  cases,  as  they 
represent  best,  typical,  and  worst  case. 

5.2.2. 1  Noisy  0  -  shift  Rcsvlts.  The  filter  input  signal  and  desired  signal  are 
both  depicted  in  Figure  5.17.  The  filter  configuration  used  for  all  4  filters  is  specified  in 
Table  5.6  while  f  igures  5.18,  5.19,  5.20,  and  5.21  show  the  error  produced  by  each  filter  for 
the  last  96  output  samples.  The  WDFl  and  'VDF'J  error  is  blocky  due  to  the  rectangular 
nature  of  the  Discrete  Walsh  functions.  Clearly,  th*  Walsh-doniain  filtci  error  is  less  than 
the  TDF  an.l  FDF  error. 


Figure  5.17.  Signal  Test  2:  0  —  shift  inputs.  This  is  the  last  96  samples  of  the  noisy 
0  —  shift  rectangular  input  and  desired  signal. 


Figure  5.18.  Signal  Test  2:  WDFl  filter  output  error  for  0  — shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =  0.05. 
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Figure  5.19.  Signal  Test  2:  WDF2  filter  output  error  for  O-s/if/t  input.  This  is  the  VVDF2 
output  error  for  the  la^t  96  output  samples  using  M  =  0.05. 


Figure  5.20.  Signal  Test  2:  TDF  filter  output  error  for  0  -  ski  ft  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.05. 
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Figure  5.21.  Signal  Test  2:  FDF  filter  output  error  for  0  —  shift  input.  Tiiis  is  the  FDF 
output  error  for  the  last  96  output  samples  using  M  =  0.05. 
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5.8.S.2  Noisy  3  —  shift  Results.  The  3  —  Jhift  signal  pair  is  depicted  in  Fig¬ 
ure  5.22.  The  filter  configuraUon  used  for  all  4  filters  is  specified  in  Table  5.7  while  Fig¬ 
ures  5.23.  5.24,  5.25,  and  5.26  show  the  error  for  the  last  96  output  samples  produced 
by  each  filter.  Clearly,  the  Walsh-doinain  filter  error  has  increased  relative  to  the  0  -  shift 
results. 


900  910  920  930  9-10  950  960  970  980  990 

Time  Inde.v.  i 


Figure  5.22.  Signal  Test  2:  3  -  shi ft  filter  inputs.  This  is  the  last  96  samples  of  the  noisy 
3  -  shi  ft  rectangular  input  and  desired  signal. 
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lablo  5.7.  .Signal  Te,st  2:  -3  —  .<hift  filter  settings 


Figure  5.23.  Signal  Test  2;  WDFl  filter  output  error  for  3  — shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.24. 


Signal  Test  2:  WDF2  filter  output  error  for  3  -shi ft  input.  This  is  the  WDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.25.  Signal  Test  2;  TDF  filter  output  error  for  3  —  shi ft  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


5-20 


Parameter 

Setting 

Block  Size 

16 

Misadjustment 

0.1 

Datasize 

992 

Table  5.8.  Signal  Test  2:  4  —  shi ft  filter  settings 


Figure  5.26.  Signal  Test  2:  FDF  filter  output  error  for  3  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


5. 2.2.3  Noisy  4  -  shift  Results.  The  noisy  4  -  shift  signal  pair  is  depicted 
in  Figure  5.27.  The  filter  configuration  used  for  ail  4  filters  is  specified  in  Table  5.8  while 
Figures  5.28,  5.29,  5.30,  and  5.31  show  the  error  for  the  last  96  output  samples  produced 
by  each  filter.  As  expected  the  Waslh-domain  filters  are  unable  to  filter  the  4  —  shift  signal 
(See  Signal  Test  1). 
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Figure  5.27.  Signal  Test  2:  4  —  shift  filter  inputs.  This  is  the  last  96  samples  of  the  noisy 
4  —  shi ft  rectangular  input  and  desired  signal. 


Figure  5.28.  Signal  Test  2:  WDFl  filter  output  error  for  4  -  shi  f  t  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  A4  =  0.1. 


5-22 


Figure  5.29.  Signal  Test  2:  WDF2  filter  output  error  for  4  —  shi ft  input.  This  is  the  WDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.30.  Signal  Test  2:  TDF  filter  output  error  for  4  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.31.  Signal  Test  2;  FDF  filter  output  error  for  4  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


5.S.2.4  Signal  Test  2  Analysis.  For  each  of  the  signal  sets  in  Signal  Test  2, 
the  three  block  processing  filters  performed  optimally  using  a  constant  /i  value.  Using  an 
independant  fi  value  for  each  bin  slowed  the  convergence  speed  of  the  filters  relative  to  using 
a  constant  [.i  (See  Signal  Test  1).  The  FDF  filter  did  uot  converge  when  an  independant  y, 
was  used  for  each  bin  and  all  four  filters  converged  more  slowly  as  the  reference  shift  was 
increased. 


Error  Performance.  Considering  the  0  —  shift  and  1  —  shift  cases,  the 
Walsh-domain  filter  outputs  were  able  to  reasonably  match  the  desired  signal.  The  error 
associated  with  the  WDFl  and  WDF2  filter  output  was  nominal  and  primarily  consisted  of 
a  constant  magnitude  with  occasional  jumps  corresponding  with  noise  spikes  in  the  input. 
The  WDF2  response  to  the  noise  spikes  was  less  pronounced  than  in  the  WDFl  case  so  that 
there  was  less  variation  in  the  error  (Figures  5.19.  5.18).  Conversely,  the  FDF  and  TDF 
filters  were  able  to  accomplish  the  necessary  time  shift,  but  unable  to  remove  the  noise  from 
the  input.  The  FDF  filter  was  still  converging  at  the  end  of  the  data  set.  This  analysis  is 
based  on  the  filter  configuration  specified  in  Table  5.6. 

The  2  —  shift  and  3  —  shift  inputs  increase  the  output  error  for  the  Walsh-domain 
filters  significantly  as  compared  to  the  0  —  shift  and  1  -  shift  inputs.  The  error  signal  is 
characteristically  the  same  except  larger  in  amplitude  by  a  factor  of  3  in  the  2  -  ski  ft  case 
and  4  in  the  d  — shift  case.  The  TDF  and  FDF  filter  error  is  characteristically  the  same  and 
shows  no  appreciable  change  in  amplitude.  This  analysis  is  based  on  the  filter  configuration 
specified  in  Table  5.7. 
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M 

Shift 

Error  Signal  Power  (Watts) 

TDF 

FDF 

WDFl 

WDF2 

0.05 

0 

CO 

CO 

I 

o 

o 

! 

CO 

1.65E;-01 

6.01E  -02 

0.05 

1 

4.83E’  -  01 

7.31E-01 

2.20/?  -  01 

0.05 

2 

3.64E-01 

3.77/?  -  01 

4.99jE;  -  01 

0.1 

3 

4.72^’  -  01 

5.37E  -  01 

1.49 

6.49/?  -01 

0.1 

4 

3.85E  -  01 

4.24/?  -  01 

24.97 

24.99 

Table  5.9.  Signal  Test  2:Error  signal  power  for  the  last  96  samples. 


Table  5.9  contains  the  normalized  error  signal  power  for  each  filter  for  the  last  96  error 
samples  produced  in  each  of  the  five  noisy  input  cases.  Comparatively,  for  the  0  —  shift, 
1  —  shi ft,  2  —  shift,  and  3  —  shi ft  cases,  the  WDF2  filter  was  better  than  the  WDFl  filter 
in  terms  of  minimizing  the  MSE.  Compared  to  the  TDF  and  FDF  filters,  the  WDF2  filter 
performed  better  in  terms  of  MSE  for  all  four  signal  sets  while  the  WDFl  filter  performed 
better  in  terms  of  MSE  for  all  but  the  three  sample  reference  shift.  The  WDFl  and  WDF2 
filters  were  unable  to  filter  the  noisy  4  —  shift  rectangular  signal  as  Figures  5.29  and  5.28 
show.  The  input  spectrum  in  this  case  has  no  zero  valued  components  due  to  the  addition 
of  the  N(0,1)  noise  to  the  input. 

The  inability  of  the  WDFl  and  WDF2  filters  to  filter  the  noisy  4  -  shi  ft  rectangular 
signal  arises  fiom  the  fact  that  the  spectrum  components  vary  from  block  to  block  due  to 
the  noise.  \'aiiation  in  the  ratio  of  the  input  spectrum  values  to  the  desired  spectrum  values 
disrupts  the  tap  adaptation  (See  Sections  4.3  and  4.4).  The  particular  bin  of  interest  for 
WDFl  is  bin  1,  because  the  only  nonzero  desired  spectral  value  is  the  sequency  1  term  (See 
Section  A. 3).  The  particular  bin  of  interest  for  WDF2  is  bin  3,  because  the  only  nonzero 
desired  spectral  value  is  the  sequency  3  term  (See  Section  .A. 3).  Figures  5.32  and  5.33  show 
the  bin  1  tap  and  Ratioi(k)  (See  Equation  4.17)  for  WDFl.  Figures  5.34  and  5.35  show 
the  bin  3  tap  and  Ratio3(k)  for  WDF2. 


Figure  5.32.  WDFl  Bin  Tap  H\{k).  This  figure  depicts  the  WDFl  Hi{k)  adaptation  track 
for  the  noisy  4  —  shi ft  rectangular  signal. 


ratio. 
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Figu^'e  5.34.  WDF2  Bin  Tap  Hz{k).  This  figure  depicts  the  WDF2  H3{k)  adaptation  track 
for  the  noisy  4  —  shift  rectangular  signal. 


Figure  5.35.  WDF2  Ratio3{k).  This  figure  depicts  the  WDF2  spectra.1  bin  3  input  to  desired 
ratio. 


M 

Shift 

Number  of  Weight  Updates 

TDF 

FDF 

WDFl 

WDF2 

0.0-5 

0 

329 

43 

1 

2 

0.05 

1 

45 

3 

3 

0.05 

2 

1-34 

24 

3 

3 

0.1 

3 

192 

25 

14 

12 

0.1 

■■ 

201 

25 

dnc 

dnc 

Table  5.10.  Signal  Test  2:  Number  of  weight  updates  to  converge 


Convergence  Speed  Comparison.  The  results  of  signal  test  2  in  terms  of 
number  of  weight  updates  required  to  converge  are  reflected  in  Table  5.10.  The  table  shows 
in  general  that  the  blockprocessing  filters  require  fewer  weight  updates  for  this  test.  Also, 
the  Walsh-domain  filters  required  the  least  number  of  weight  updates,  with  the  exception  of 
the  4  —  shi ft  case.  The  WDFl  and  WDF2  filteis  had  similar  performance  for  the  1  —  shift 
a.nd  2  -  shift  cases.  The  WDFl  filter  Wcis  able  to  achieve  convergence  (i.e.  10%  of  the 
NMSE)  after  a  single  weight  update  whereas  the  WDF2  filter  required  two.  The  WrjF2 
filter  outperformed  the  WDFl  filter  on  the  3  —  shift  case,  only  requiring  twelve  weight 
updates  whereas  the  WDFl  filter  required  fourteen.  The  Walsh-domain  filter  entries  for  the 
4  -  shift  input  are  indicated  in  the  table  as  “dnc”;  indicatin^j  “did  not  converge”. 

5.2.3  Signal  Teal  3  1  his  test  compares  the  WDFi  and  WDF2  continuous  signal 
filtering  performance  against  the  TDF  and  FDF  filters.  A  simple  sinusoidal  signal  is  used 
as  a  continuous  signal  -epresentative.  The  h'  pothesis  is  that  the  Walsh-domain  filters  will 
converge  mr  re  slowh  and  produce  more  error  filtering  the  sinusoidal  signal  than  the  FDF 
aiul  TDF  filters  and  l.iat  shifting  the  input  will  degrade  tho  V’,.lsh-filter  performance.  There 
are  two  rUributcs  of  the  DWT  which  suggest  this  hyprtlvs  '': 

1.  The  DWT  of  a  continuous  signal  produces  more  spectral  terms  than  the  corresponding 

DFT  spectrum  does  (See  .Section  2. 1.2. 2). 

2.  The  DWT  spectrum  is  not  time-shift  invariant  (See  Section  2.1.3). 

The  input  signal  used  in  the  test  is  depicted  in  Figure*  5.36  and  serves  as  the  input 
and  desired  signal  in  this  test.  .\  992  .sample  d.atasizc  is  u.scd  because  it  produces  an  integer 
number  of  16-point  blocks,  as  oppo.sed  to  a  datasize  of  1000  which  does  not.  The  input 
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Figure  5.36.  Signal  Test  3  Sinusoidal  Waveform. 


signal  was  time-shifted  to  assess  time-shift  affects  on  filter  error  performance  and  convergence 
speed.  An  incremental  shift  of  1  sample  is  made  on  each  filter  run  relative  to  the  desired 
signal,  with  a  maximum  relative  shift  of  4  samples.  For  the  remainder  of  this  test,  the  input 
signal  for  an  n-point  relative  shift  is  designated  the  n  —  shift  input.  The  results  of  the 
4  —  shi ft  case  are  presented  because  it  was  representative  of  the  results  produced  for  all  the 
shift  Ccises.  The  purpose  of  this  test  is  to  evaluate  the  WDFl  and  WDF2  sinusoidal  signal 
filtering  performance  in  relation  to  the  TDF  and  FDF  filters.  The  input  signai  used  in  the 
test  is  depicted  in  Figure  5.36.  This  signal  functions  as  the  input  and  desired  signal.  An 
incremental  shift  of  1  sample  is  made  on  each  filter  run  relative  to  the  desired  signal,  with 
a  maximum  relative  shift  of  4  samples.  Only  the  results  for  the  four  sample  reference  shift 
are  presented  because  it  was  representative  of  the  results  produced  for  all  the  shift  case.s. 

5.2.3. 1  Noisdcs.s  4  —  shift  Results.  The  sinusoidal  4  —  .shift  signal  pair  is  de¬ 
picted  in  Figure  5.37  and  the  filter  configuration  used  for  all  4  filters  is  specified  in  Table  5.1 1. 
Figures  5.38,  5.39,  5.40.  and  5.11  show  the  error  for  the  last  96  output  samples  produced 
by  each  filter. 
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Parameter 

Setting 

Block  Size 

16 

Misadjustment 

0.1 

Datasize 

992 

Table  5.11.  Signal  Test  3:  4  —  shift  filter  settings. 


Figure  5.37.  Signal  Test  3:  4  — shift  filter  inputs  .  This  is  the  noiseless  4  — shift  sinusoidal 
input  and  desired  signal. 


Figure  5. 38.  Signal  Test  3:  VVDFl  filter  output  error  hr  4 -  shift  input.  This  figure  depicts 
the  WDFl  output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.39.  Signal  Test  3:  WDF2  filter  output  error  iorA  —  shift  input.  This  is  the  WDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.40.  Signal  Test  3:  TDF  filter  output  error  for  4  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.41.  Signal  Test  3:  FDF  filter  output  error  for  4  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  A/  =0.1. 
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5. 2.3. 2  Signal  Test  3  Analysis  For  the  two  Walsh-domain  filters,  an  indepen¬ 
dant  gain  constant  fj,  for  each  bin  was  optimum  in  terms  of  minimizing  the  output  error 
while  a  constant  y  value  was  optimum  in  terms  of  minimizing  the  error  for  the  FDF  filter 
in  all  cases.  Figures  5.38  thru  5.41  show  the  output  error  over  the  last  96  samples  for  each 
filter.  The  optimum  fi  algorithm  was  used. 

En'or  Performance.  The  results  of  test  3  in  terms  of  error  signal  power, 
normalized  to  a  one  ohm  resistor,  for  the  last  96  error  samples  are  contained  in  Table  5.12. 
Results  for  all  sample  shift  cases  produced  indistinguishable  squared  error  plots.  The  TDF 
and  FDF  filters  produced  a  zero  error  output  as  Figures  5.40  and  5.41  show.  The  WDFl 
filter  error  (Figure  5.38)  was  nominal  compared  to  the  WDF2  filter  error  (Figure  5.39). 

Convergence  Speed  Comparison.  Table  5.13  summarizes  the  results  of  sig¬ 
nal  Test  3  in  terms  of  number  of  weight  updates  updates  required  to  converge  (i.e.  reach 
10%  of  normalized  mean-square-error).  Entries  with  an  *  designate  results  determined  using 
an  uependant  bin  y  value.  The  table  reflects  that  the  blockprocessing  filters,  with  the 
exception  of  WDF2  for  shifts  3  and  4,  required  fewer  weight  updates  to  converge.  The  FDF 
filter  was  the  quickest  in  terms  of  weight  updates  required;  only  needing  two  weight  updates. 
The  two  Walsh-domain  filters  performed  equally  for  the  first  two  reference  shifts;  requiring 
five  weight  updates  for  the  1  -  ski  ft  input  and  eight  for  the  2  —  shift  input.  The  WDFl 
filter  required  less  than  half  the  number  of  weight  updates  required  by  the  WDF2  filter  for 
the  3  and  4  —  shi ft  signals. 


M 

Shift 

Error  Signal  Power  (Watts) 

TDF 

FDF 

WDFl 

WDF2 

0.1 

1 

0 

0 

b.90E  -  05 

3.33jE  -  02 

0.1 

2 

0 

0 

b.%E  -  05 

3.335  -  02 

0.1 

3 

0 

0 

b.%E  -  05 

3.335  -  02 

0.1 

4 

0 

0 

5.90E:  -  05 

3.33  -  02 

Table  5.12.  Signal  Test  3:Error  signal  power  for  the  last  96  samples. 
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Table  5.13.  Signal  Test  3:  Number  of  weight  updates  to  converge. 
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5.2.4  Signal  Test  4  Signal  test  4  is  an  extension  of  Signal  Test  3  (See  Section  5.2.3). 
This  test  evaluates  the  WDFl  and  WDF2  noisy  sinusoidal  signal  filtering  performance  in 
relation  to  the  TDF  and  FDF  filters.  The  WDFl  and  WDF2  filter  error  should  increase 
significantly  relative  to  the  Signal  Test  3  results.  This  is  baised  on  the  testing  accomplished 
in  Sections  4.3  and  4.4.  The  desired  signal  used  in  the  test  is  the  signal  in  Figure  5.36  and 
the  input  is  the  same  signal  with  noise  added.  The  filter  input  is  simply  a  shifted  version  of 
the  desired  signal.  The  maximum  shift  was  4  samples.  For  the  remainder  of  this  test,  the 
input  signal  for  an  n-point  relative  shift  is  designated  the  n  —  shift  input.  Filter  output 
results  are  presented  for  the  0  —  shift,  2  —  shift,  and  4  —  shift  input  cases,  as  they  represent 
best,  typical,  and  worst  case. 

5.2.4. 1  Noisy  0  —  shift  Results.  The  sinusoidal  0  —  s/ii/i  signal  pair  is  depicted 
in  Figure  5.42  and  Table  5.14  specifies  the  filter  configuration.  Figures  5.43,  5.44,  5.45, 
and  5.46  show  the  error  for  the  last  96  output  samples  produced  by  each  filter  using  the 
optimum  n  calculation  method. 


Parameter 

Setting 

Block  Size 

16 

Misadjustment 

0.1 

Datcisize 

992 

Table  5.14.  Signal  Test  4:  0  —  shift  filter  settings. 
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Figure  5.42.  Signal  Test  4;  0  —  shift  inputs.  This  is  the  last  96  samples  of  the  noisy 
0  —  shi ft  sinusoidal  input  and  desired  signal. 


Figure  5.43-  Signal  Test  4:  WDFl  filter  output  error  for  0  -  shi  ft  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =0.1. 
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Figure  5.44.  Signal  Test  4:  WDF2  filter  output  error  for  0  —  shi ft  input.  This  is  the  VVDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.45.  Signal  Test  4:  TDF  filter  output  error  for  0  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.46.  Signal  Test  4:  FDF  filter  output  error  for  0  —  shift  input.  This  is  the  FDF 
output  error  for  the  Icist  96  output  samples  using  M  =  0.05. 


5-38 


5.2.4-^  Noisy  2  —  shift  Results.  The  2  —  shift  signal  pair  is  depicted  in  Fig¬ 
ure  5.47  and  Table  5.15  specifies  the  filter  configuration.  Figures  5.48,  5.49,  5.50,  and  5.51 
show  the  error  for  the  last  96  output  samples  produced  by  each  filter  using  the  optimum  fi 
calculation  method. 


Figure  5.47.  Signal  Test  4:  2  -  shi ft  filter  inputs.  This  is  the  last  96  samples  of  the  noisy 
2  -  shift  sinusoidal  input  and  desired  signal. 


Parameter 

Setting 

Block  Size 

16 

Misadjustment 

0.1 

Datasize 

992 

Table  5.15.  Signal  Test  4:  2  —  shift  input  filter  settings. 
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Figure  5.48.  Signal  Test  4:  WDFl  filter  output  error  for  2  — shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =0.1. 
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Figure  5.49.  Signal  Test  4:  WDF2  filter  output  error  for  2  —  shi ft  input.  This  is  the  WDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


0 


Figure  5.50.  Signal  Test  4:  TDF  filter  output  error  for  2  —  shift  input.  This  is  the  TDF 
output  error  for  the  Icist  96  output  samples  using  M  =  0.1. 


Figure  5.51.  Signal  Test  4:  FEF  filter  output  error  for  2  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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5.2. 4-3  Noisy  4  —  shift  Results.  The  4  -  shift  input  pair  is  depicted  in  Fig¬ 
ure  5.52.  Table  5.16  specifies  the  filter  configuration.  Figures  5.53,  5.54,  5.55,  and  5.56 
show  the  error  for  the  last  96  output  samples  produced  by  each  filter  using  the  optimum  ii 
calculation  method. 


Figure  5.52.  Signal  Test  4:4-  shi ft  filter  inputs.  This  is  the  last  96  samples  of  the  noisy 
4  -  shift  sinusoidal  input  and  desired  signal. 


Parameter 

Setting 

Block  Size 

16 

Misadju.stment 

0.1 

Datasize 

992 

Table  5.16.  Signal  Test  4:  4  —  shift  filter  settings. 
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Figure  5.53.  Signal  Test  4;  WDFl  filter  output  error  for  4  —  shift  input.  This  is  the  WDFl 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.54.  Signal  Test  4;  \VDF2  filter  output  error  for  4  -  ski  ft  input.  This  is  the  WDF2 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 
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Figure  5.55.  Signal  Test  4:  TDF  filter  output  error  for  4  —  shift  input.  This  is  the  TDF 
output  error  for  the  last  96  output  samples  using  M  =  0.1. 


Figure  5.56.  Signal  Test  4:  FDF  filter  output  error  for  '1  —  shift  input.  This  is  the  FDF 
output  error  for  the  last  96  output  samples  using  M  =0.1. 
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M 

Shift 

Error  Signal  Power  (Watts) 

TDF 

FDF 

WDFl 

WDF2 

0.1 

0 

7.05F;  -  02 

1.49E  -  01 

2.93F;-01 

0 

1 

00 

0.1 

1 

6.71  if;  -02 

1.38F;  -  01 

2.67F;  -  01 

0.1 

2 

6.22F;  -  02 

1.26F:  -  01 

6..52F;  -  01 

4.67F;-01 

0.1 

3 

5.S3F;  -  02 

1.20F:  -01 

3.19 

2.13 

0.1 

4 

5.72  -  02 

1.20£;-01 

3.01 

1.96 

Table  5.17.  Signal  Test  4:Error  signal  power  for  the  last  96  samples. 


5. 2. 4.4  Signal  Test  4  Analysis.  .An  indepenclant  bin  y  was  optimum  for  VVDFI 
and  \\'DF2  in  minimizing  the  error  for  all  reference  shifts  while  the  FDF  filter  did  not 
converge  for  any  reference  shift  using  an  independant  bin  y. 

Error  Performance.  Time  shifting  the  input  did  not  affect  the  output  error 
for  the  TDF  and  FDF  filters  as  clearly  shown  in  Figures  5.46,  5.45,  5.50,  5.51,  5.55,  and 
5.56.  The  TDF  error  is,  on  average,  approximately  half  that  of  the  FDF  filter.  Figures  5.4-3, 
5.14,  5.48,  5.49,  5.53,  and  5.54  show  that  the  output  error  for  the  Walsh-domain  filters 
increases  as  the  reference  shift  of  the  input  increases  while  Table  5.17  contains  the  results  of 
Signal  Test  4  in  terms  of  the  error  signal  power,  normalized  to  a  one  ohm  resistor,  for  the 
la.st  96  error  samples.  The  VV’DF2  output  error  is  not  as  significant  as  the  WDFl  filter  and 
changes  much  less  dramatically  during  the  test  than  the  WDFl  filter  error.  In  bf>tn  cases 
though,  the  error  is  much  more  significant  than  the  FDF  or  TDF  filter  error. 

The  source  of  increasing  error  generated  by  the  WDFl  and  WDF2  filters  is  the  i)rogres- 
sive  reduction  in  power  of  some  of  the  input  spectral  components  that  correspond  with  the 
desired  signal  spectral  components  as  the  reference  shift  between  the  two  signals  iiurea.se.'' 
(See  Section  .A. 3).  For  the  noisy  input,  the  signal  to  noise  latio  of  the.se  bins  is  reduced  which 
induces  noise  in  the  bin  tap  adaptation.  Considering  the  noisy  2-  .^hift  sinusoid  input.  Fig¬ 
ures  5.57  thru  5.60  show  the  resulting  WDFl  input  to  desired  bin  ratios  (Eipiation  4.17) 
for  bins  9  and  13,  and  the  resulting  tap  adaptation  tracks  for  those  bins.  Figures  5.61  thru 
5.61  show  the  same  information  concerning  WDF2,  which  is  using  a  32-point  transform  of 
the  input.  In  this  case  bins  19  and  27  are  good  examples  of  the  adaptation  noise  created  by 
bin  ratio  variation.  Considering  the  4  -  .<:/»?/{  input,  Figures  5.57  thru  5.60  address  WDFl 
bin  numbers  9  and  13.  Figures  5.69  thru  5.72.  address  WDF2  bin  numbers  19  and  27. 


Figure  5.57.  Signal  Test  4:  WDFl  filter  tap  Ho{k)  for  the  2-  shi ft  input  using  independent 
bin  ft  and  M  =0.1. 


Figure  5.5S.  Signal  Test  4. WDFl  R(itioo[k).  This  is  the  ratio  of  lho2-^hifl  input  IGpoinl 
DW'T  bin  9  and  the  desired  signal  16-point  DWT  bin  9  versus  k. 
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Figure  5.59.  Signal  Test  4;  WDFl  filter  tap  Hizik)  for  the  2-shi ft  input  using  independent 
bin  fi  and  M  =  0.1. 


Figure  5.60.  Signal  Test  4;WDF1  Ratioi3{k).  This  is  the  ratio  of  the  2  -  shift  input 
16-point  DWT  bin  13  and  the  desired  signal  16-point  DWT  bin  13  versus  k. 
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Figure  5.61.  Signal  Test  4:  WDF2  filter  tap  for  the  2—shi  ft  input  using  independent 

bin  fi  and  M  =  0.1. 


Figure  5.62.  Signal  Test  4:VVDF2  Ratwio{k).  This  is  the  ratio  of  the  2  —  shift  input 
32-point  DVVT  bin  19  and  the  desired  signal  32-point  DWT  bin  19  vers  .s  k. 
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Figure  5.63.  Signal  Test  4:  WDF2  filter  tap  H27{k)  for  the  2— shift  input  using  independent 
bin  fi  and  M  =  0.1, 


Figure  5.64.  Signal  Test  4:WDF2  Ratio2-{k).  This  is  the  ratio  of  the  2  —  shift  input 
32-point  DWT  bin  27  and  the  desired  signal  32-point  DWT  bin  27  versus  1;. 
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Figure  5.65.  Signal  Test  4:  WDFl  filter  tap  Hs{k)  for  the  A  — shift  input  using  independent 
bin  n  and  M  =  0.1. 


Figure  5.66.  Signal  Test  4;VVDF1  Ratioo{k).  This  is  the  ratio  of  the  A  — shift  input  16-point 
DWT  bin  9  and  the  desired  signal  16-point  DWT  bin  9  versus  k. 
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Figure  5.67.  Signal  Test  4;  VVDFl  filter  tap  H\3{k)  for  the  i— shift  input  using  independent 
bin  jjL  and  M  =  0.1. 


Figure  5.68.  Signal  Test  4:VVDF1  Ratio\z{k).  This  is  the  ratio  of  the  4  —  shift  input 
16-point  DVVT  bin  1.3  and  the  desired  signal  16-point  DWT  bin  13  versus  k. 
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Figure  5.69.  Signal  Test  4:  WDF2  filter  tap  HiQ{k)  for  the  A— ski  f  i  input  using  independent 
bin  n  and  M  =  0.1. 


Figure  5.70.  Signal  Test  4:WDF2  Rahoio{k).  This  is  the  ratio  of  the  4  —  shift  input 
32-point  DVVT  bin  19  and  the  desired  signal  32-point  DWT  bin  19  versus  k. 
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Figure  5.71.  Signal  Test  4:  WDF2  filter  tap  Ihrik)  for  the  4—shi ft  input  using  independent 
bin  ft  and  M  =  0.1. 


Figure  5.72.  Signal  Test  4:WDF2  Ratio2-{k).  This  is  the  ratio  of  the  4  -  shift  input 
32-point  DVVT  bin  27  and  the  desired  signal  32-point  DVVT  bin  27  versus  k. 
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M 

Shift 

Number  of  Weight  Updates 

TDF 

FDF 

VVDFl 

WDF2 

0.1 

0 

21 

1 

9 

9 

im 

21 

2 

5 

6 

0.1 

2 

22 

2 

10 

10 

0.1 

3 

22 

2 

6H- 

49' 

0.1 

4 

21 

2 

61-f 

61+ 

Table  5.18.  Signal  Test  4:  Number  of  weight  updates  to  converge. 


Convergence  Spec<J  Comparison.  The  convergence  speed  comparisons  of 
signal  test  4  are  reflected  in  Table  5  IS  which  summarizes  the  number  of  weight  updates 
required  to  converge.  Entries  with  an  *  designate  results  determined  using  an  independent 
bin  jj.  value  while  an  entry  with  a  indicates  convergence  was  not  achieved. 

5.3  Filter  Processing  Speed  Comparison 

This  section  presents  a  processing  speed  performance  comparison  between  the  W'DFl, 
\'VDF2,  TDF,  and  FDF  adaptive  filters.  Table  5.19  contains  the  time  required  for  each 
filter  to  process  a  1000  sample  input  sequence.  The  VVDFl,  WDF2,  and  FDF  filters  were 
configured  to  process  blocksizes  of  N  —  8  and  N  =  4  while  the  TDF  filter  was  configured  with 
8  and  4  taps.  Run-time  for  each  filter  began  after  all  data  constructs  had  been  initialized, 
the  data  was  loaded,  and  the  gain  constant  was  calculated.  .Mso.  all  e.xfernal  and  internal 
write  statements  were  removed  for  the  lun.  Run-time  was  stopped  after  all  data  had  Ijcen 
processed. 

The  VVDFl  and  VVDF2  filters  used  a  Fast  Walsh  Transform  (FWT)  (7).  Computa¬ 
tionally.  the  FWT  requires  A’ log2  A'  summations  for  an  .V-point  transform  and  no  multi¬ 
plies.  The  FDF  filter  used  a  Cooley-Tukey  radix-2  FFT  algorithm  [6: 1.35-4.36]  that  re(|uircs 
2A’ log2  A  —  4  A'  real  multiplies.  The  TDF  filter  requires  2.V'^  real  multiplies  to  pioduce  A' 
output  points  (See  Section  2.2.2. 1). 

.As  indicated  in  Table  5.19,  the  TDF  filter  recorded  the  fastest  time  for  the  A'  =  4 
case  and  the  W'DFl  filter  was  the  fastest  for  N  =  8.  F3oth  VVDFl  and  VV’DF2  were  much 
faster  than  FDF.  The  time  required  for  the  FWT  and  FFT  routines  to  perform  a  16-point 
transfoim  is  contained  in  'Fable  5.20,  excluding  set-up  time.  Cleail,\.  the  FWT  is  much  faster 


than  the  FFT.  The  FDF  filter  requires  5  FFTs  per  block  to  produce  N  output  points  (See 
Section  2. 2. 2. 2).  The  FWT’s  faster  processing  time  and  the  fact  that  the  Walsh-domain 
filters  are  using  only  three  tranforms  per  block  (See  Sections  3.1  and  3.2)  accounts  for  the 
faster  processing  times  relative  to  FDF. 


N 

Processing  Time  in  Seconds 

TDF 

FDF 

WDFl 

WDF2 

4 

4.22 

.52.68 

6.87 

9.89 

8 

7.85 

60.80 

7.74 

10.00 

Table  5.19.  Processing  Time:  Time  required  to  process  1000  data  samples.  For  TDF  N 
indicates  number  of  taps;  N  indicates  blocksize  otherwise. 


Transform 

Processing  Time  in  Seconds 

FWT 

0.05 

FFT 

0.11 

Table  5.20.  Time  required  to  perform  a  16-point  transform. 


5-4  Swiunai'i/. 

This  purpose  of  this  chapter  was  to  establish  a  performance  measure  for  WDFl  and 
VVDF2,  relative  to  each  other  and  the  TDF  and  FDF  filters.  In  terms  of  conveigence  speed 
and  error  performance,  the  Walsh-domain  filters'  performance  degiadcd  as  the  reference  shift 
was  increased  in  all  4  signal  tests. 

Since  numerous  observations  were  made  in  the  course  of  testing  error  perfoiniance  of 
the  filters  in  this  chapter  it  would  be  wise  to  icaddiess  each  of  them  at  this  time.  The  major 
error  performance  results  from  this  chapter  are  as  follows: 

1.  In  Signal  Test  3  (See  Section  5.2.3)  all  4  filters  produced  error  results  that  were  invariant 
to  the  shift. 

2.  The  4  -  shift,  rectangular  signal  in  Signal  Test  1  (Section  5.2.1)  and  Signal  Test  2 
(Section  5.2.2)  produced  the  worst  performance  for  the  WDFl  and  WDP’2  filters. 
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•  In  Signal  Test  1  the  4  —  bkift  input  results  in  a  single  sequency  component  DWT 
for  the  desired  and  a  different  single  sequency  DWT  for  the  input.  Since  the  signals 
are  periodic  and  the  block  size  matches  the  period,  both  DWTs  arc  constant  from 
block  to  block.  With  single  nonzero  noncoincident  components,  the  input  cannot 
be  filtered  to  achieve  the  desired  signal. 

•  In  Signal  Test  2,  the  input  DWT  component  position  corresponding  with  the 
desired  DWT  nonzero  component  is  due  to  noise  only.  In  'his  case,  the  variation 
of  the  input  bin  of  interest  is  such  that  the  bin  tap  cannot  converge.  This  problem 
also  arises  for  the  WDFl  and  WDF2  filters  in  Signal  Test  4  (Section  5.2.4). 

3.  The  3  —  shift  and  4  —  shift  noiseless  sinusoidal  spectiums  result  in  low  power  com¬ 
ponents  that  correspond  with  higher  sequency  components  in  the  desired  spectrum. 
.'\dding  noise  to  the  input  results  in  a  low  signal-to-noise-ratio  (SNR)  for  these  low 
power  bins.  In  filtering  this  noisy  spectrum  to  achieve  the  desired  spectrum,  the  low 
SNR  bin  tap  gradient  follows  the  continuously  changing  relationship  between  the  con¬ 
stant  valued  desired  bins  and  the  noi.sy  input  bins.  Thus,  the  bin  tap  adaptation 
tracks  are  correspondingly  noisy  which  limits  the  filtering  abilty  of  the  WDFl  and 
WDF2  filters. 

f.  In  general,  the  WDF2  filter  error  signal  performance  was  better  for  the  noisy  input 
cases,  relative  to  the  WDFl  filter. 

5.  The  WDFl  filter  erior  performance  was  better  for  the  noiseless  input  cases,  relative  to 
the  WDF2  filter. 

In  this  thesis,  convergence  speed  was  measured  in  terms  of  the  number  of  weight 
updates  required  to  achieve  10%  NMSE  (See  Section  5.1).  Using  this  criteria,  the  Walsh- 
domain  filters  were  faster  than  the  TDF  and  FDF  fillers  when  tested  using  rectangular 
signals.  The  WDFl  filter  was  better  than  WDF2  in  Signal  Test  1  while  WDF2  was  better  in 
Signal  Test  2.  The  FDF  filter  required  the  least  numbei  of  wcight-u|)dates  for  the  sinusoidal 
input  u-sed  in  Signal  Test  3  and  4.  Comparing  the  two  Walsh-domain  filters;  WDFl  required 
as  many  or  fewer  weight-updates  as  WDF2  did  for  the  noi.sele.ss  sinusoidal  input  in  Signal  Test 
3.  WDF2  required  as  many  or  fewer  w'eight-updates  as  WDFl  did  for  the  noisy  sinusoidal 
input  in  Signal  Test  4. 

A  processing  speed  comparison  (See  Section  5.3)  showed  the  Walsh-domain  filters  to 
be  at  least  four  times  as  fast  as  FDF  for  N  =  S.  The  WDFl  filter  was  the  fastest  of  the 


blockprocessing  filters  used  in  this  thesis  followed  by  the  \VDF2  and  FDF  filters,  in  that 
order.  This  is  based  on  the  FDF  filter  using  a  radix-2  FFT  and  the  Walsh-domain  filters 
using  a  Fast  Walsh  Transform.  The  TDF  filter  was  slightly  slower  than  the  WDFl  filter  for 
a  blocksize  of  N  =  8.  The  next  chapter  presents  the  conclusions  and  recommendations  for 
this  research  effort. 


VI.  Conclusions  and  Recommendations 


6.1  Conchisions 

This  thesis  investigated  the  development  of  two  Walsh-domain  adaptive  filters.  The 
first,  WDFl,  was  implemented  using  a  frequency-domain  circular  convolution  design  while 
the  second,  WDF2,  was  implemented  using  a  modified  Fast  LMS  design.  A  time-domain 
adaptive  filter  (TDF)  and  the  Fast  LMS  filter  (FDF)  were  also  implemented  in  software  and 
used  for  comparison.  Rectangular  and  sinusoidal  test  signals  were  used.  Shifted  noisy  and 
noiseless  versions  of  both  were  used  to  conduct  error  performance,  convergence  speed,  and 
processing  speed  performance  comparisons  for  the  TDF,  FDF,  WDFl,  and  WDF2  filters. 
The  following  subsections  address  the  performance  comparison  conclusions. 

6.1.1  Error  Performance  Conclusions.  Based  on  the  last  96  error  samples  produced 
by  each  filter,  the  error  performance  conclusions  from  this  research  effort  are  the  following; 

•  The  Walsh-domain  filters  are  better  than  the  TDF  and  FDF  filters  in  terms  of  mean- 
square-error  (MSE)  filtering  discontinuous  input  signals,  while  the  TDF  and  FDF  filters 
are  better  for  continuous  signals. 

•  Input  shifts  cause  WDFl  and  WDF2  error  performance  to  degrade  for  noisy  ar.d  noise¬ 
less  discontinuous  signals. 

•  The  WDFl  filter  is  better  than  the  WDF2  filter  for  noiseless  signals  while  the  WDF2 
filter  is  better  than  the  WDFl  filter  for  noisy  signals. 

®  .A  single  fi  is  better  than  separate  /t's  for  Walsh-domain  filters  filtering  rectangular 
input  signals  while  a  .separate  fi  is  better  for  sinusoidal  input  signals. 

•  Shifts  in  the  input  data  do  not  degrade  W'DFl  and  WDF2  performance  when  filtering 
noiseless  sinusoidal  signals.  That  is  not  the  ca.se  for  noi.sy  signals. 

•  Shifts  in  the  input  data  do  not  affect  TDF  and  FDF  MSE  performance. 

•  The  FDF  filter  produces  less  error  using  a  single  bin  ;/  for  simple  sinusoids  and  rect 
angular  signals,  relative  to  the  results  obtained  using  a  .separate  bin  /<. 
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6.1.2  Convergence  Speed  Performance  Conclusions.  The  convergence  speed  criteria 
was  the  number  of  weight  updates  required  to  achieve  10%  Normalized  Mean  Square  Error 
(NMSE)  where  normalization  was  with  respect  to  the  desired  signal  power.  For  the  nois\' 
input  signals,  MSE  learning  curves  were  generated  from  100  data  files  using  .Additive  White 
Gaussian  Noise  (AWGN).  Using  this  criteria  it  was  concluded  that; 

•  The  Walsh-domain  filters  converged  more  slowly  when  filtering  sinusoidal  input  signals 
as  opposed  to  rectangular  input  signals. 

•  The  Walsh-domain  filters  converged  more  quickly  for  noisj  and  noiseless  rectangular 
input  signals  and  more  slowly  when  filtering  noisy  and  noiseless  sinusoidal  signals, 
relative  to  the  FDF  filter. 

•  The  TDF  filter  converged  more  slowly  than  the  FDF,  W'DFl.  and  W'DF2  filters  when 
filtering  noisy  and  noiseless  rectangular  signals. 

•  Beymnd  a  two  sample  shift  of  the  input,  the  Walsh-domain  filters  converge  more  qu’ckly 
using  a  separate  bin  p  when  filtering  noisy  and  noiseless  sinusoidal  signals. 

•  Beyond  a  two  sample  shift  of  the  input,  the  TDF  converges  more  quickly  than  VVDF2 
for  the  noiseless  sinusoidal  signal  and  more  quickly  than  WDFl  and  WDF2  for  noisy 
sinusoidal  signals. 

•  Convergence  speed  was  the  same  for  VVDF2  and  WDFl  for  noisy  and  noiseless  rectan¬ 
gular  signals. 

•  The  WDF2  sinusoidal  input  signal  convergence  speed  for  the  noiseless  input  degrades 
more  quickly  as  the  inj)ut  shift  increases  and  degrades  at  the  same  rate  for  noisy  input, 
relative  to  the  WDFl  sinusoidal  input  signal  convergence  speed  performance. 

•  The  Walsh-domain  filter.s  converge  more  quickly  filtering  a  rectangular  input  .-.ignal 
using  a  single  bin  /<•.  relative  to  the  results  obtained  using  a  separate  bin  //. 

•  Data  shifting  degraded  the  convergence  speed  of  the  Walsh-domain  filters. 

•  The  convergence  speed  of  the  TDF  and  FDF  filters  was  independant  of  the  input  shift. 

6. 1. Processing  Speed  Performance  Conclusions.  The  FDF  filter  was  implemented 
with  a  radix-2  FFT  while  the  Walsh-domain  filters  used  a  Fast  Walsh  Transform  (FWT). 
The  FDF.  WDFl,  and  WDF2  filters  were  configured  to  procc.ss  S-point  ?.nd  l-point  block 
sizes  and  the  TDF  filter  was  (onfigured  with  8  and  I  taps.  The  datasize  was  1000  samples 


and  the  run  time  started  after  all  data  constructs  had  been  initialized,  the  data  was  loaded, 
and  the  gain  constant  Wcis  calculated.  Based  on  this  configuration,  the  processing  speed 
performance  conclusions  for  this  research  effort  are  the  following: 

•  The  TDF  filter  processed  the  1000  samples  more  cjuickh-  than  the  FDF,  WDFl.  and 
\VDF2  filters  for  small  N. 

•  The  WDFl  filter  processed  the  1000  data  samples  more  quickly  than  the  FDF  and 
WDFl  filters. 

•  The  W’JFl  filter  is  faster  than  the  WDF2  filter. 

•  Tl:e  FDF  filter  processes  the  1000  samples  more  slowly,  relative  to  the  TDF.  \VDF2, 
and  WDFl  filters. 

6.1J,  Filtering  Limitations. 

•  A  WDFl  and  WDF2  filtering  limitation  e.xists  due  to  the  time-shift  variant  nature  of 
the  DV\’T.  This  is  based  on  the  fact  that  a  signal  data  shift  can  result  iti  a  DWT  that 
has  different  sequcncy  terms  than  the  DWT  of  an  unshifted  version  of  the  signal.  The 
4  -  shift  input  signal  in  Signal  Test  2  was  an  occurrence  of  this. 

•  The  quality  of  the  convergence  characteristics  for  WDFl  and  WDF2  is  inversely  pro¬ 
portional  to  the  variance  of  the  input-to-desired  sequency  ratios. 

6.2  Subjective  Ranking 

The  TDF.  FDF.  WDFl.  and  WDF2  filters  can  be  subjectively  ranked  using  the  re¬ 
sults  of  Chapter  1.  Table  6.1  provides  subjective  rankings  for  the  filters  when  the  noiseless 
and  noisy,  sinusoid  and  rectangular  inputs  were  used.  .\  rank  of  !  indicates  best.  Overall 
performance  was  considered  for  each  input  signal.  The  1  -  shift  rectangular  input  wa.s  not 
included  in  the  rankings  presented  becau.se  it  was  considered  an  e.xccption. 

6.3  Recommendations 

There  are  .several  recommendations  which  might  make  a  rea.sonable  thesis  topit  or  serve 
as  topics  within  related  re.scarch. 

1.  The  WDF2  filter  implemented  in  this  thesis  u.sed  a  o0%  overlap  to  create  the  A-th  block 
input  vector.  One  might  further  investigate  what  effects  the  (hoice  of  another  overlap 
percentage  would  have  on  the  filtering  performance  of  the  filter. 


2.  The  Walsh-domain  filters  were  implemented  using  a  modified  form  of  the  complex  LMS 
algorithm.  One  could  also  implement  the  filters  using  a  modified  form  of  the  Leakage 
LMS  algorithm  to  investigate  whether  this  would  improve  the  general  convergence 
characteristics  of  the  Walsh-domain  bin  taps. 

3.  Finallj',  this  thesis  used  a  simple  representative  of  a  continuous  and  discontinuous 

gnal  to  test  the  Walsh-domain  filters.  To  further  evaluate  the  filters,  more  complex 
representatives  of  each  type  of  signal  could  be  used. 


Criteria 

Sine  Input  (Noiseless/Noisy) 

Red  Input  (Noiseless/Noisy) 

TDF 

FDF 

WDFl 

WDF2 

TDF 

FDF 

Process  Time 

2/2 

4/4 

1/1 

3/3 

2/2 

4/4 

1/1 

3/3 

Convergence  Speed 

4/2 

1/1 

2/3 

3/3 

4/4 

3/3 

1/1 

2/2 

Error 

1/1 

1/2 

21 A 

3/3 

2/2 

3/3 

1/4 

1/1 

Table  6.1.  Subjective  Ranking  for  Noiseless/Noisy  Input. 
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Appendix  A.  Discrete  Walsh  Transform 


This  Appendix  presents  examples  of  Discrete  Walsh  Functions  and  the  Discrete  Walsh 
Transform  (DWT)  and  its  properties. 

A.l  Discrete  Walsh  Functions 

For  a  series  of  N  terms,  the  discrete  Walsh  functions  can  be  specified  as  [1:59] 


p-i 


WAL{n,i)  =  J](-l)"p->-^+>r+i) 

(A.l) 

r=0 

i,n  =  0, 1,2, . . . ,  A  —  1 

(A.2) 

r  =  0,l,2,...,p-  1 

(A.3) 

where  N  =  2^  defines  p.  The  indexes  i,n  are  expressed  in  terms  of  their  binary  digits  such 
that 

i  —  (fp,Zp_j,  •  •  • ,  fl,fo)2 

n  =  (np,np_i,...,ni,no)2  (A.4) 

An  example  calculation  for  the  N  —  4  series  term  VVAL{3, 1)  using  Equations  A.l  and  A. 5 
is  presented.  In  evaluating  W AL{3, 1)  we  start  with 

A  =  4  =  2^ 

which  means  there  are  p  =  2  product  terms,  so  that 

I 

WAL{S,l)=  J](-i)”—('r+.r+,) 

r=0 


and 


i  =  .(0  1)2 

n  =  (1  1)2 
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The  first  product  term  (r  =  0)  then,  is 


=  (_l)i(o+i) 
=  -1 


The  second  product  term  (r  =  1)  is 


=  (-!)’■« 

=  1 

WAL{Z,l)  can  now  be  calculated  by  multiplying  the  first  and  second  product  terms 
together,  so  that 


HMT(3,1)  =  -M 

Figure  A.l  shows  the  N  =  8  series  Discrete  Walsh  functions. 

A.S  Dyadic  Convolution 

Dyadic  convolution  is  defined  cis  [1:100] 


N-l 

-T  =  l/.'V  .T,t/r©.  (A. 5) 

1=0 

and  using  the  Discrete  Walsh  Transform  (See  Section  2.1.2) 

N—i 

-T=  XI  (A.6) 

Tl=0 


Two  N  =  4  point  time-domain  sequences  x,  and  t/,-  are  given  by 

•T,  =  {1  5  3  8) 
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Vi  =  {2  7  4  1} 


where  the  xq  and  yo  terms  are  the  1  and  2  terms  respectively.  Using  Equation  A. 5,  for  r 
we  have 


3 

*0  =  1  /4  Xiy0®t 

1=0 

=  l/4[xo?/o  +  xiVi  +  .T2Z/2  +  3:32/3] 
=  l/4[l-2  +  5-7  +  3-4  +  S-l] 

=  14.25 

For  r  =  1  the  result  is 

3 

zi  =  1/4  •2/1®, • 

t=0 

=  1/4[xo2/i  +  xitjo  +  X22/3  +  3:32/2] 

=  l/4(l-7  +  5-2  +  3-l +  8-4] 

=  13.00 


For  r  =  2  the  convolution  result  is 


3 

-2  =  1/4  X!  •'^>7/2®. 

i=0 

=  1  /4  [xo2/2  +  3: 1 2/3  +  3:2  2/0  +  3:32/1  ] 
=  l/4[l-4  +  5-l +3-2  +  8-7] 

=  17.75 

Finally,  for  r  =  3 

3 

^3  =  1/4]^.t,-2/3®.- 

1=0 

=  1  /4  (xo2/3  +  3: 1 2/2  +  .x'22/1  +  3:32/0] 
=  1/4(M +5-4 +3-7  +  8-2] 

=  14.50 
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The  first  step,  in  appljnng  the  DV\T  to  perform  the  dyadic  convolution  of  x,  and  ?/,, 
is  to  perform  the  DWT  on  both  sequences.  Using  the  matrix  vector  form  of  the  transform, 
the  4-point  Walsh  matrix  is  given  by 

till 
11-1-1 
1-1-1  1 
1-11-1 

The  DWT  then  is  given  by 

X„  =  (l/4)W,x,-  (A.8) 

For  a  general  4-point  sequence,  written  as  a  column  vector 

xf  =  {A  B  C  D] 

such  that  the  4-point  DWT  is  given  by 

1111 

X-  ,11-1-1 

Xn  =  1./4 

1-1-1  1 
1-1  1  -1 

The  resulting  DWT  is  given  by 

A  +  B  +  C  +  D 
A+B-C-D 
A- B-C+D 
A- B+C- D 


•A-o 


Substituting  in  the  x,  and  ij,  sequence  values  for  A,B-C,D  yields  a  DWT  for  .t,  of 


X„  =  1/4 


17 

—5 

1 

-9 


and  for  ?/,•  of 


Y,.  =  1/4 


14 

4 

-S 

-9 


Performing  the  multiplication  of  Y„  and  X„  yields 


Z„  = 


14.875 

-1.25 

-0.50 

1.125 


The  inverse  DWT  of  Z„  is  evaluated  by  multiplying  the  1x4  matrix  W,i  and  4x1  vector  Z„ 


14.875 

—  1.40 

-0-50 

1.125 

which  yields  the  4x1  vector 

14.25 

1.3.00 

Zr  = 

17.75 
14. .50 


(.A.IO) 


(A.Il) 
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This  result  is  equivalent  to  the  result  calculated  using  the  dyadic  convolution  sum. 

Utilizing  the  FFT  instead  of  the  D\\T  in  this  example  results  in  circular  convolution 
of  the  two  sequences.  Linear  convolution  i.  performed  if  both  sequences  are  zero  end-padded 
with  4  zeros.  The  result  of  zero  padding  the  x,  and  y,  sequences  and  taking  the  inverse  D^\’T 
of  the  product  of  their  transforms,  produces  the  result  in  Equation  .4.11  multiplied  by  1/2. 
The  two  sequences  in  this  case  are 

.T.  =  {1  5  3  8  0  0  0  0} 

?ji  =  {2  7  4  1  0  0  0  0} 

The  required  8-point  DVVT  Walsh  matrix  is  given  by 

11111111 
1  1  1  1  -1  -1  -1  -1 

1  1  -1  -1  -1  -1  1  1 

1  1-1-1  1  1-1-1 

1-1-1  1  1-1-1  1 

1-1-1  1-1  1  1-1 

1-1  1-1-1  1-1  1 

1-1  1-1  1-1  1-1 


The  resulting  DVVT  for  is 


The  resulting  DWT  for  Xi  is 


Multiplying  X„  and  Y„  and  taking  the  inverse  DWT  produces 


7.125 

6.5 

8.875 

7.25 

Zt  = 

0 

0 

0 

0 

which  is  the  result  in  Equation  A. 11  scaled  by  1/2  and  end-padded  with  4  zeros. 


A. 3  DVi'T  of  Time-shifted  periodic  signals 

A. 3.1  Sinusoid.  The  effects  of  shifting  a  sinusoid  on  the  resulting  DWT  are  presented 
in  this  section.  The  sinusoidal  signal  used  has  a  period  of  16  samples.  DWT  spectra  of  one 
and  two  periods  of  this  signal,  shifted  and  unshifted,  are  presented  for  one  (Section  A. 3. 1.1) 
and  two  periods  (Section  A. 3. 1.2)  of  the  signal.  Notationally  an  n-point  shifted  sinusoid  will 
be  referred  to  as  the  n  -  shift  sinusoid. 

A. 3.1. 1  16-Point  'Transform.  The  16-point  DWT  of  the  signal  in  Figure  A. 2  is 
represented  for  zero,  single,  two,  three,  and  four  sample  shifts  in  Figures  .A. 3,  A.4.  A. 5, 
A. 6,  and  .A. 7.  Clearly,  the  shift  variant  nature  of  the  DWT  is  demonstrated  in  that  the  16- 
point  DWT  of  this  signal  is  changing  as  the  signal  is  shifted. 

A. 3. 1.2  32-Point  Transform.  The  32-point  DWT  of  the  signal  in  Figure  A. 2  is 
represented  for  zero,  single,  two.  three,  and  four  sample  shifts  in  Figures  .A. 8,  .A. 9.  .A. 10, 
A. 11,  and  .A. 12.  .Notationally  an  n-point  shifted  sinusoid  will  be  leferred  to  as  the  n  —  shift 
sinusoid. 

Clearly,  the  32-  point  DWT  of  this  signal  is  changing  as  the  signal  is  shifted.  .Also,  the 
spectrums  arc  clearly  different  from  those  in  Figures  A.3,  A.4,  A. 5,  A. 6,  and  .A. 7,  because 
the  DWT  does  not  assume  periodicity  of  the  input. 


Figure  A.2.  This  is  a  sinusoid  with  16  sample  period  and  amplitude  of  5 


Figure  A. 3.  This  is  the  DWT  of  one  period  of  the  0  —  sin  ft  sinusoid. 
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Figure  A.4.  This  is  the  DWT  of  one  period  of  the  1  —  shift  sinusoid 
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Figure  A. 7.  This  is  the  DVVT  of  one  period  of  the  -!  —  shift  sinusoid. 
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Figure  .A. 9.  This  is  the  DVVT  of  two  periods  of  the  1  —  shift  sinu.soid 


A- 12 


Figure  A. 10.  This  is  the  DVVT  of  two  periods  of  the  2  —  shift  sinusoid. 
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Figure  .A.l  1.  This  is  the  DWT  of  two  periods  of  the  3  —  shi /'  sinusoid. 


Figure  .A.  12.  This  is  the  OWT  of  two  periods  of  the  •!  —  .</?;//  sisMisoi<i. 
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A. 3. 2  Jicciangular.  The  effects  of  shifting  a  rectangular  signal,  on  the  resulting  DVVT 
are  presented  in  this  section.  The  rectangular  signal  used  has  a  period  of  1C  samples.  DWT 
spectra  of  one  and  two  periods  of  this  signal,  shifted  and  unshifted,  are  presented  for  one 
(Sec^'on  A. 3. 2.1)  and  two  periods  (Section  A. 3. 2.2)  of  the  signal.  Notationally  an  7?-point 
shifted  rectangular  signal  will  be  referred  to  as  the  n  —  shift  rectangular  &J  gnal. 

A. 3.2.1  16-Point  Transform.  The  16-point  DWT  of  the  signal  in  Figure  A. 13 
is  represented  for  zero,  single,  two,  three,  did  four  sample  shifts  in  Figures  A. 14,  A. 15, 
A. 16,  A. 17,  and  A. 18.  Clearly,  the  16-  point  DWT  of  this  signal  is  changing  as  the  signal 
is  shifted,  which  again  demonstrates  tJie  shift  variant  nature  of  the  DWT. 


Figure  A. 13.  This  is  a  rectangular  signal  with  16  sample  period  and  amplitude  of  5 


A. 3. 2. 2  32-Point  Transfonn.  The  32-point  DWT  of  the  signal  in  Figure  A.  13 
is  represented  for  zero,  single,  two,  three,  and  foui  sample  shifts  in  Figures  .A. 19,  .A. 20, 
A. 21,  A.22.  and  .A. 23.  Clearly,  the  32-  point  DWT  of  this  signal  is  changing  as  the  signal 
is  shifted. 
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Figure  A. 14.  This  is  the  DWT  of  one  period  of  the  0  —  shift  rectangular  signal. 


Figure  .A.  16.  This  is  the  DWT  of  one  period  of  the  2  —  shift  rectangular  signal. 


A- 15 


Figure  A. 18.  This  is  the  DVVT  of  one  period  of  the  4  -  shift  rectangular  signal. 


Figure  .A. 19.  This  is  the  DWT  of  two  periods  of  the  0  -  shift  rectangular  signal. 
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Figure  A. 20.  This  is  the  DWT  of  two  periods  of  the  1  —  shift  rectangular  signal. 
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is  the  DVVT  of  two  periods  of  the  4  —  shift  rectangular  signal. 
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Appendix  B.  WDFl  Weight  Update 


This  Appendix  derives  the  WDFl  Walsh-domain  gradient  vector  which  is  used  in 
Chapter  II  (see  Section  3.1).  An  example  is  presented  for  the  N  =  A  block  size.  A  WDFl 
time-domain  gradient  example  is  also  presented  for  the  block  k  —  2  using  the  block  size 
N  —  A.  This  example  is  used  to  facilitate  a  comparison  with  the  WDF2,  FDFl,  and  FDF2 
filters. 

B.l  Walsh-Doinain  Gradient 

The  Walsh-domain  weight  vector  is  specified  by 

n{k  +  1)  =  Wk)  +  ^lX{k)E{k)  (B.l) 

where  the  X{k),  E(^’))  H(^’)  vec.tor  components  are  real  valued  quantities  since  the  Dis¬ 

crete  Walsh  Transform  (DWT)  produces  real  valued  components.  The  product  X{k)E{k)  in 
Equation  B.l  defines  the  Walsh-Domain  gradient  vector  Vn  i(A’)  for  WDFl.  Using  Vn/i(A‘), 
Equation  B.l  can  be  expressed  as 

Ho{k+\)  1  r  Hoik)  1  [  V„q,(A-) 

Ih{k+l)  Hdk)  V„-,.(A-) 

Hi\--i(k+l)  H,\„i{k)  ^iru-_i(^') 

The  first  task  in  deriving  the  Walsh-domain  gradient  vector  i(/.  )  is  to  define  some 
necessary  time-domain  notation.  Using  the  notation  .r,  to  repicsent  the  input  sequence,  the 
N  input  sequence  values  which  define  the  Ath  input  block  can  be  represented  In  where 

?  =  0, 1,  . . ,  A'  —  1.  Using  this  notation,  the  N-point  A*th  block  input  vector  is  defined 

X(A')  =  (.Tfc.v  ...  .J-A./V+.V-i)  (&-3) 
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Applying  the  same  notation  to  the  desirei!  time-domain  sequence,  the  associated  kih  block 
desired  vector  is  represented  as 


<i{k)  —  {(lhN  ••• 


(B.4) 


The  kth  block  input  DWT  matrix  X(k)  is  given  by 


X{k)  =  diag{W{[x(k^’) 


(B.5) 


where  W.  is  the  forward  DWT  operator.  The  forward  and  inverse  N-point  DWT  pair  [1:50] 
is  as  follows: 

N-l 

(B.6) 


N-l 

=  1/A' 

1=0 


and 


A'- 1 

.r.=  X:  W.HMA(77,/) 

n=0 


(B.7) 


The  DWT  components  of  the  A'th  N-point  input  block,  Xn{k),  comprise  the  diagonal  com¬ 
ponents  of  the  input  n.a./ix  as  indicated  in  the  following  equation 


X(k)  = 


Ao(A-) 


0 


AMA-) 


XN[k) 


(B.S) 


The  Walsh-domain  output  vector  for  the  A’th  block  is  calculated  as  follows; 


Y{k}  =  X(k)l\{k) 


so  that 


’  Xo(k) 

0 

Hoik) 

Y{k)  = 

//.(A:) 

0 

Wv-,(A-) 

Hiv-iik) 

(B.y) 
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The  resulting  VValsh-Domain  output  vector  is  then 


Y{k)  = 


Xo{lc)}Ioik) 

Xx{k)II^{k) 


The  Walsh-domain  error  vector  for  the  A*th  block  is  defined 


Eik)  =  D(A-)  ~  \{k) 


where  D(A-)  is  the  A:th  block  desired  DW'T  component  vector.  Therefore,  D{k) 


D(A-)  =  W{[d(i.,v)  ...  f/(t/v+A--i)]} 


and 


D(A-)  = 


Do{k) 

Dxik) 


Av-,(A-) 


Substituting  Equations  B.!  and  H.IO  into  Equation  B.ll  results  in 


Do{k)  -  Ao(A-)//o(A:) 
Dx{k)-Xxik)Hxik) 


T»a-.i(A-)  -AV-,(A-)//.v_,(A-) 
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(B.IO) 


(B.ll) 

is  defined 

(B.12) 


(B.I3) 


Performing  the  matrix  vector  inuitiplication  X(^’)E(A;)  produces 


Y'ivio(^) 

Xo{k)[Do{k)  -  Xo(A:)//o(A-)] 

Vivi(A-)  = 

Y'ivi,(A:) 

= 

XXk)[DXk)-XXk)HXk)] 

.  V, A-)_ 

AV-i(A-)p/v-.(A-)- AVi(A-)/^v-i(A-)]  _ 

(B.14) 


This  is  the  result  used  in  Section  3.1. 

B.S  Time-domain  Gradient 

The  equivalent  time-domain  gradient  expression  for  VVDFl  is  given  by 

Vj{k)  =  1/A'  ^  c,{k)x(iQj){k),  i  =  0, 1, . . . ,  A'  -  1  (B.15) 

.=0 

where  j  is  the  time-domain  weight  index,  ©  indicates  'r.odulo-2  addition  for  the  binary 
representations  of  i  and  and  ,{k)  defines  the  A-th  block  gradient  term  for  each  time- 
domain  weight.  The  .r,(A-)  and  e,(A;)  terms  represent  the  ith  component  of  x(A-)  and  e(A:) 
respectively,  during  the  A:th  block: 

X(A-)  =  (.Tt,v  ...  .rA.A:+,v_i] 

=  (xofA-)  ...  3-(a-_,)(A-))  (B.16) 

and 

e(A-)  =  [e^-.v  ...  ca.,v+/v-i] 

=  [co(A:)  ...  C(,v_,)(A-)]  (B.17) 

The  first  step  in  defining  the  c,(A-)  terms  is  to  define  ?/,(A-).  The  y-Xk)  term.s  are  derived  from 
the  inverse  DWT  (Equation  B.7)  of  Y(A:)  (Equation  B.IO): 

.v(A-)  =  W-'{Y(A-)}  (B.18) 


where  W~^  is  the  inverse  DWT  operator.  Notationally,  the  N  output  sequence  values  for 
the  kth  block  are  represented  by  VkN+t,  where  f  =  0, 1, . . . ,  -  1.  Therefore,  the  A-th  block 

output  vector  y{k)  is  represented  by 


y{k)  =  [yki^  ...  y^;^'+N-lV  (B.19) 

The  e,{k)  terms  represent  the  fth  component  of  the  time-domain  error  vector  G{k)  such  that 


e(A-)  =  W-ME(A-)} 

=  [{dkiV-ykN)  •••  (dr-jv+yv-i  -  J/jtA'+iV-i))^ 
=  [eo{k)  ...  eA-_,(A:)F 

Using  Vj{k),  the  tin  e  domain  weight  update  equation  can  be  specified 

h,{k+l)  =  h,ik)  +  fiV^{k) 

so  that 


(B.20) 


(B.21) 


ho{k  +  1) 

hoik) 

Vo(A-) 

hi(k  +  l) 

= 

hrik) 

+  fl 

V,{k) 

lt\-\(k  -f  1 ) 

.  h^’-l{k) 

(B.22) 


For  a  .'V  =  4  block  size,  the  expression  for  the  k  =  2  block,  where  in  general  k 
Ijecon'.es 


=  0.1. 


’  //o(3)  ' 

'  ho{2)  ' 

<3 

O 

to 

..  ...  1 

/;,(3) 

+  /' 

V.(2) 

//2(3) 

b,{2) 

V,{2) 

M3) 

.  ^3(2)  . 

(B.2.3) 
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Eacli  gradient  term  is  calculated  using 


Vi{2)  =  1/4  ei(2)x,,e„(2),  j  =  0, 1, . . . ,  3 


(B.24) 


where 


x(A:)  =  [:C8  Xg  Xio  .Tn) 
e(A')  =  (eg  eg  ejo  Cn) 

The  initial  sample  index  for  both  x(A*)  and  c(A‘)  begins  at  ?  =  8  since  AA'  =  2x4. 

The  j  =  0  term  is 

Vo(2)  =  l/4(eo(2)To(2)  +  e,(2)a:,(2)  +  e2(2)x2(2)  +  e3(2).T3(2)) 

=  l/4(e83:s  +  C9X9  +  CioaTio  +  en^^ii) 

The  j  =  1  term  is 

V,(2)  =  l/4[eo(2)x,(2)  +  e,(2).ro(2)  +  e2(2).r3(2)  +  e3{2).T2(2)) 

=  l/4[esX9  +  egXs  +  Cio-Xn  +  enXjo) 

The  j  =  2  term  is 

V2(2)  =  l/4(eo(2)x2(2)  +  e,(2).T3(2)  +  C2(2).to(2)  +  C3{2).r,(2)) 

=  1/4(63X10+  C9X11  +  CioXs  +  CiiXo) 

Finally,  the  j  =  3  term  is 

^3(2)  =  1/4(co(2)x3(2)  +  c,(2).r2(2)  +  C2(2).r,(2)  +  C3(2).ro(2)] 

=  l/4{csXii  +  £9X10  +  C10X9  +  ciiXs) 

Each  of  the  Vj(2)  terms  represents  the  dyadic  convolution  of  the  A+h  error  block  and  input 
block. 
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Appendix  C.  WDF2  Weight  Update 


This  Appendix  derives  the  \VDF2  Walsh-domain  gradient  vector  .  An  example  is 
presented  for  the  N  =  2  block  size.  A  WDF2  time-domain  gradient  example  is  also  presented 
for  the  block  k  =  2  using  the  block  size  A'  =  4. 

C.l  Walsh- Domain  Gradient 

The  Walsh-domain  \VDF2  weight  vector  is  specified  by 

H(/:  +l)  =  Uik)  +  iiX{k)E{k)  (C.l) 

where  the  X{k),  E(/:),  and  li{k)  vector  components  are  real  valued  quantities  and  the  product 
X{k)E{k)  defines  the  WDF2  gradient  vector  VjvaC^*)-  The  VVDF2  filter  requires  the  use  of 
2A'-point  transforms  due  to  the  50%  overlap  method  employed  in  determining  the  input 
vector,  .^ccordingly,  the  filter  uses  2N  Walsh-domain  taps  to  filter  the  data.  In  vector  form 
the  weight  update  equation  can  be  expressed  as 


//o(A:+l) 

IMk) 

//i(/.-+l) 

= 

IIi{k) 

+  /' 

Vh-2,(A-) 

IliN-iik  1) 

.  //-v-i(A:) 

.•\t  this  point  we  begin  the  Vn-2(A-)  derivation  by  defining  the  A’th  block  \\’DF2  time- 
domain  input  vector  x(A').  Using  the  notation  .r,  to  rcprc.sent  the  input  .''etiuence.  the  .V  input 
sequence  values  which  define  the  tth  input  block  can  be  represented  by  where  i  = 

0,1 . .V  -  1.  Next,  the  N-poinl  previous  block  and  N  point  current  block  are  concatenated 

to  produce  the  klh  block  input  vector,  defined  as 

x(A-)  =  ...  J'Ct.V-l)  3’(AiY)  ...  .T(t.  +.V-I)] 

■  -v-  ■'  ■“  ■  “V  ' 

(Jt— I  Woc/r  kth  block 


C-l 


The  A'th  block  input  transform  matrix  X(A-)  is  given  by 


X(A')  =  f/ia^{W(a:(AA'-jV)  ...  .T(tA'-i)  -Tca-A')  3:(;..a'4-a-i))} 

' - v - '  ' - V - ' 

{h-l)th  block  klb  block 


(C.4) 


where  W  is  the  forward  D\\'T  operator.  The  forward  and  inverse  X-point  DW’T  pair  {1:.50] 
is  as  follows: 

A'-l 


Xn  =  1//V  X^x,vr/i/:(n,o 

1=0 


(C.5) 


and 


,v-i 

.-r.  =  E  A',.H'.4L(n.7) 
11=0 


(C.6) 


Representing  the  DWT  transform  components  of  the  ‘2.V-point  A’th  block  input  vector 
as  A*„(A-),  X(A-)  can  be  expressed  as 


X(A-)  = 


A'o(A-) 


A',(A-) 


A'2a--,{A-) 


(C.7) 


The  first  step  in  deriving  the  Walsh-doinain  expression  for  l:i(A’).  is  the  evaluation  of  the  A’th 
block  Walsh-domain  output  vector  Y(A): 


'  Xo(A-) 

0 

//o(A-) 

V(A-)  = 

A’,  (A) 

//.(A) 

0 

A ■>.%■_ I  (A  ) 

.  //2.v-,{A-) 

Performing  the  multiplication  of  ihe  2.Vx2,V  matrix  X(h}  and  2.Vxi  vector  Hit)  yields  the 
2.'Vxl  vector  \'{h)  given  by 


r 


Y{k)  = 


k) 

Xi{k)n,{k) 


(C.9) 


Taking  the  inverse  DW’T  of  Y(t)  and  saving  the  last  X  values  (See  Section  3.2)  produces  the 
tth  block  output  vector.  Reprc.senling  the  .V  output  .sequence  values  whieh  (hfine  the  tth 

output  block  as  yh.x-t-  where  i  =  0;  1 _ ,  .V  —  1.  the  tth  block  time-domain  output  block 

vector  is  defined 


y{k)  =  (</(jt;V), - y{kS->:\-i)V 

=  Iasi  N  terms  of  W-^X(k)lUk)}  (r.iO) 

The  W“'  operator  used  in  Equation  C.IO  is  the  inverse  DWT  operator.  I'sing  the  inverse 
DVVT  sum  (Equation  C.6),  the  y(/c)  vector  can  be  expressed  as 


VkX 

i:*=o -V)av.it-)//„(a-) 

y{k)  = 

ykx+i 

= 

E;.=o‘' A' d-n.Vn(/.-)//.{/>-) 

yk.\^x-\ 

E*=o'  HT-l/.(n.2.V  -  \)X„{k)II„{k) 

'I'he  VValsh-domain  error  vector  E(A-)  for  the  klh  block  is  defined  by 

E(A')  =  VV{(0 _ ■ . .  0,  -  y(k.\'))  ■■■  (d(fc.v.!..v_i)  - //(A-.v+.v-i))}^}  ((.12) 

.  <^rror  bloirk 


whoro  roprcscnls  the  ?lh  sample  in  the  klh  A'-poinl  desired  secpience  block. 


Using  the  linear  property  of  the  DWT  (See  Section  2.1.2),  Equation  C.12  can  be 
expressed  as 

E(k:)  =  W{[P  .^.  0,  d(kN)  •••  d(kN+N-l)V] 

N  zeros 

->V{[P  .^.  0,  y{kN)  ■■■  y{kN+N-i)V}  (C.13) 

N  zeros 

Evaluation  of 

H^lfP  0  y{kN)  •••  y(kN+N-i)]^}  (C.14) 

A'  zeros 

using  Equations  C.Sand  C.ll  produces  the  vector 

ESv‘  E“o  '  WAL{0,i)WAL{n,i)X„{k)H.{k) 

_1_  Ll^'  WAL{l.i)WAL{n,i)X„l,k)H„{k) 

2N  : 

.  ZISn'  E“o‘‘  WAL(2N  -  l,i)WAL{n,i)X^{k)H.{k) 

Cancellation  of  terms  reduces  this  expression  to 

Xoik)Ho{k)-X^{k)H,{k) 

-Xo{k)Ho{k)  +  X^{k)IMk) 

X2{k)H2{k)  -  X3{k)H2{k) 

-X2{k)H2{k)  +  X3{k)H:i{k) 

X(2N—i){k)H(2N-A)ik)  -  Xf^2,V-3){k)dI(2.\'-3)ik) 

~X[2N-A)ik)H(2N-4)ik)  +  X^2N-3){k)kl(2N-3)(k) 

Xi^2N-7)(k)H(2N-2){k)  -  X{2N-l)ik)H(2h'-\){k) 
-X^2N-2){k)H(2N-2)ik)  +  X(2N-l)ik)H{2N-}}(k) 


1/2 


(C.16) 


where  {1/2N)-N  =  1/2.  For  N  greater  than  2 


W[P  0.  (hkN)  ■■■  d(l{N+N-l)f 


N  zeros 


(C.I7) 


can  be  expressed  as 

-^Noik) 

-DN,{k) 

D,v,{k) 

1/2  ;  (C.18) 

~-k^Nn-2  {k) 

-DN^_,{k) 

^i^N-\ik) 

where  the  Di^„{k)  terms  represent  the  nth  component  of  the  N-point  DWT  of  the  current  N- 
point  block  of  the  desired  signal.  The  1/2  factor  results  because  the  .V-point  DWT  terms  were 
calculated  using  a2A^-point  DWT.  The  N-point  DWT  components  of  the  desired  signal  occur 
due  to  the  zero  front-padding  of  the  vector  transformed.  For  N  =  2  Term  C.17  produces  the 


vector 


(^(2k)  +  d(2t 


(2t+l) 


—  d(2k)  —  d(2fc+l) 
~d{2k)  +  d(2k+\) 
(i{2k)  -  d(2t+i) 


(C.i9) 


C-5 


Substituting  the  vector  results  CMS  and  C.16  into  Equation  C.13,  results  in 


E{k)  =  1/2 


^Noik) 

Xo{k)Hoik)  -  Xi(k)HAk) 

-DNoik) 

-Xo{k)Ho{k)  +  XAk)Hi{;c) 

-D/v,(/c) 

X2ik)H2{k)  -  X3{k)H3{k) 

D^Ak) 

-1/2 

-X2ik)H2ik)  +  XAk)H3ik) 

DNN^Ak) 

X{2N-4){k)H(2N-4){k)  —  X(2N~3)ik)H(2N-3){k) 

-DNt,_Ak) 

—  X(2N-4){k)H(2N-4){k)  +  X{2N-3){k)H(2N-3)ik) 

-DN;,.Ak) 

X{2N-2){k)H(2N-2){k)  —  X^2N-l)ik)H^2N-l)ik) 

DN^-iik) 

_  —X[2N-2)ik)H(2N-2)ik)  +  X(2N-\)ik)H^2N-l){k) 

(C.20 


which  simplifies  to 


E(A-)  =  1/2 


Di,,{k)  -  Xo{k)Hoifc)  +  X^{k)H^{k) 
-DNoik)  +  Xo{k)Ho{k)  -  Xi{k)Hi{k) 
-D^,,ik)  -  X2ik)H2ik)  +  X:i{k)Hi{k) 
Dt,,{k)  +  X2{k)H2ik)  -  X2{k)H^{k) 


~  X(2N-‘i){^')f^{.2jV-4){k)  +  X(^2N-3){k)H{2N-Z){k) 
~Dl\!l._^{k)  +  X^2l\!-4){k)H^2^'-^){k)  —  X^2N-3){k)H(2N-3){k) 

-D.\'^_^{k)  -  X^2^'-2){k)H^2.^’-2){k)  +  -Y(2A'-1)(^)/^(2.V-1)(^') 
DNn_^(k)  +  X[2tV-2){k)Jl{2N-2){k)  -  X{2,\--l){k)lJ{2N-i){k) 


(C.2] 


C-6 


Performing  the  multiplication  of  the  2Nx2N  matrix  X(A')  and  2.'Vx  1  vector  E(A')  yields  the 
2A^xl  vector  Vnr2( A') 


ViV2(A’) 


X'vv2o(^) 

Viv2i(A;) 

Viy22(A:) 

'^\V2i{k) 


^H'22A-_3(^') 


(C.22) 


Xo{k)[D^^,{k)  -  Xo{k)Ho{k)  +  A-,(A-)/^,(A0] 
.Y,(A)(-Da.„(A-)  +  Xo{k)Hoik)  -  X,{k)Hy{k)] 
X2{k)[-D^,ik)  -  X2{k)H2{k)  +  X3{k)H2(k)] 
X3{k)[D^,ik)  +  X2{k)H2{k)  -  A'3(A*)//3(A')] 


^{'2N—i){k)[D!\;f^,_^{k)  —  A'’(2A'— i)(A')//(2A'-i)(A')  +  2n2N-3){k)H{2i\'-:i)(k)] 
A'’(2;V-3){A’)(- Av^-_2(A')  +  X{2N-4){k)H{2N-4){k)  -  A(2/V-3)(A’)//(2;V-3)(^')] 

A'(2;V-2)(^')["'^'V^._,(A')  —  X^2N-2^>{k)H^2^'-2){k)  +  A(2A'-1)(A')//(2/V-1)(^')] 

A(2N-I)(^')(^N/v-i(^’)  +  ^[2N-2){k)H{2N-2){k)  -  X^2,V-\)ik)H^2^'-l){k)] 

(C.23) 


This  is  the  result  presented  in  SecLior.  3.2.  For  A’  =  2  the  Walsh-domain  gradient  is 


'^lV2o(^') 

'  Xo{k)[d^2^:)+d^2k+y)-2Xo(k)lh{k)  +  2Xyik)Hy{k)]  ' 

Y'h'2|(A‘) 

=  1/4 

X^{k)[-d^2,)  -  d(2fc+i)  +  2Xo{k)Ho(k)  -  2Xy{k)Hy{k)] 

Viy22(A-) 

X2{k)[-d^2k)  +  d(2fc+,)  -  2A2(A-)//2(A-)  +  2X3{k)H3ik)] 

Vvy23(A-) 

.  AVAi[r/(2t.)-cWi)  +  2A^2(A-)//2(^-)-2..Y3(A-)A/3(A:)l  _ 

C-7 


C.2  Time-domain  Gradient 


The  equivalent  time-domain  gradient  expression  for  VVDF2  is  given  Ijy 

2/V-l 

=  1/2A'  52  J  =  0, 1, . . . ,  2A'  -  1  (C.25) 

1=0 

where  j  is  the  time-domain  weight  index,  ®  indicates  modulo  ^  addition  for  the  binary 
representations  of  i  and  j,  and  V’j(i)  defines  the  klh  block  gradient  term  for  each  time- 
domain  weight.  The  .v,{k)  and  e,{k)  terms  represent  the  fth  component  of  x(A-)  and  e(A-) 
respective! \',  during  the  A'th  block; 

x(A-)  =  ...  2'(tA'-i)  ...  a:(^,v+A'-i)) 

' - - '  ' - - ' 

(/;— 1  block  kth  block 

=  [xo{k)  ...  T(2A'-i)(A-)]  (C.26) 


and 


e(A-)  =  [p  .^.  0^  {d(i:i\’)  -  y(kN\)  ■■■  -  y{kN+i\-\))] 

A'  zeros 


T 


kih  error  block 


=  (eo(A)  ...  £(2A’-l)(A')f 


(C.27) 


Using  Vj(A-),  the  time  domain  weight  update  equation  can  be  specified 

h,{k-\-l)  =  kj{k)  +  ftVj{k)  (C.28) 

so  that 


lio{k  1  j 

ho(k) 

Vo(A-) 

hi{k  -f  1) 

= 

/m(A-) 

-h  f‘ 

V,{A-) 

k2i\'-i{k  +1) 

hzN-\(k) 

^2A’-l(  A') 

C-8 


For  a  N  =  4  block  size,  the  expression  for  the  k  =  2  block  becomes 


’  /^o(3j  ■ 

■  hg{2)  ■ 

’  Vo(2)  ■ 

//,(3) 

= 

/m(2) 

V,{2) 

h{Z) 

Each  gradient  term  is  calculated  using 


y,(2)  =  1  /S  ei(2)rt|,5,^l(2),  j  =  0, 1 , . . , ,  7 


1=0 


(C.30) 


(C.31) 


where 


\{k)  =  [a;^  Ts  .Ce  ^7  Xg  arjo  ^u] 

c{k)  =  [0  0  0  0  Cs  e<)  Cio  Cn) 


The  first  sequence  value  in  xik)  is  because  k  =  2  and  N  =  4,  so  that  kN  -  A'  =  4. 
Similarly,  the  first  nonzero  sequence  value  in  e{k)  is  6$  because  kN  =  S.  Excluding  the  zero 
valued  products  in  each  sum,  the  time-domain  gradient  terms  arc  as  follows: 

The  j  ■-  0  term  is 


^o(2) 


I/S(c,(2).t,(2)  -f  e5(2).T5(2)  -f  c42)t6(2)  +  er(2)a:{2)] 

1/S(esx.s  -f  Cg-Tg  Gioa'ic  +  Cjiari]] 


The  j  =  1  term  is 

V,(2)  =  l/S[e,,(2)a-5(2)  -f  e5(2).r,(2)  +  co(2)r7(2)  H-  er(2)T6r2)j 
=  l/Sfeg.rg -p  ega:8  + 

The  j  =  2  term  is 

N,{2)  =  l/8(e42)x6(2)-be5(2)TT(2)  +  e6(2)x,(2)-fc7(2)^^^^^ 

=  l/8[c8.rio  +  cgX\  \  -b  Cio.T8  +  Cna:g] 


The  i  =  3  term  is 


V3(2)  =  l/8[e,(2)T7(2)  +  e5(2)x6(2)  +  e6(2).T5(2)  +  er(2)a:4(2)j 

=  1/S(e82;ii  +  egXjo  +  cio-'Cs  +  CiiXs] 

The  j  =  4  term  is 

V,(2)  =  l/8[e.H;2)xo(2)  +  e5(2)x,(2)  +  e6(2)x2(2)  +  e7(2)x3(2)] 

=  1/8(68X4  +  69X5  +  cioXe  +  611X7] 

Tile  j  =  5  term  is 

V8(2)  =  l/8[e4(2)x,(2)  +  e5(2)xo(2)  +  e6(2)x3(2)  +  e7(2)x2(2)] 

=  1/8(68X5  +  69X4  +  610X7  +  611X6] 

The  j  =  6  term  is 

V6(2)  =  l/8(e4(2)x2(2)  +  e5(2)x3(2)  +  e6(2)xo(2)  +  e7(2)xi(2)] 

=  1/8(65X6  +  69X7  +  610X4  +  611X5] 

I'^inalK'.  tlie  j  =  7  term  is 


^7(2) 


1/8(64(2)x3(2)  +  65(2)x2(2)  +  66(2)x,(2)  +  e7(2)xo(2)] 

1/8(65X7  +  69X0  +  610X5  +  611X4] 


A  comparison  of  the  gradient  terms  just  calculated  with  those  calculated  for  WDFl  in 
Appendix  B.  clearly  reveals  a  difference.  Theie  are  8  VVDF2  terms  and  only  4  WDFl 
gradient  tciins.  This  i.s  hecause  the  number  of  time  duniain  taps  equals  the  transform  size: 
WDF2  u.ses  2A -point  transforms  and  \\’DFl  uses  A'-point  traiiisforms.  The  first  N  V\'DF2 
gradient  \alues  ar^'  equal  to  the  WDFl  value  multiplied  by  1/2.  The  1/2  factor  results  from 
the  change  in  transform  size. 


C’-IO 


Appendix  D.  FDFl  Weight  Update 


This  Appendix  derives  the  FDFl  frequenci’-domain  gradient  vector.  An  example  is 
presented  for  the  N  =  1  block  size.  A  FDFl  time-domain  gradient  example  is  also  presented 
for  the  block  k  =■  2  using  the  block  size  F  =  4.  This  example  is  used  to  facilitate  a 
comparison  with  VVDFl,  VVDF2,  and  FDF2. 

D.I  Frequency-Domain  Gradient 

The  frequency-domain  weight  vector  is  siK'cified  by 

Hlk  +  l)  =  II(A:)  +  yX‘{k)E{k)  (D.I) 

where  the  X{k),  E(^),  and  H(A')  vector  components  are  in  general  complex  valued  quantities. 
The  notation  indicates  complex  conjugate.  The  product  X’(A:)E(^-)  in  Equation  B.l  defines 
the  frequency-domain  gradient  vector  Vpi(A*)  for  FDFl.  Using  Vp,(A-),  Equation  D.I  can 
be  expressed  as 


/7o(^-+l) 

Hoik) 

Ihik+l) 

= 

Hi[k) 

+  /i 

Vn,(A-) 

Hi\i-i{k  1) 

.  //:V-,(A-) 

Given  that  the  X{k).  E(A-),  and  II(A-)  vector  components  are  in  general  complex,  the  weight 
update  equation  for  the  jih  tap  can  be  repre.scnted  as  two  separate  update  operations; 

+  1)  =  Drcaljik)  /iX' yircolj(k)  (D'D 

DimagjU  T  1 )  =  Dimagj{k)  ( ^)  (D.-I) 

whcie  //rc<i/,(^’)  and  Himagj(k)  represent  the  real  and  imaginary  parts  of  /7,(A:).  The  terms 
F\rtai,(k)  and  F pumagjik)  represent  the  real  and  imaginary  parts  o{X'p.,{k).  Therefore, 
during  the  Arth  block  each  frecjuency  domain  tap  is  decomposed  into  a  real  component  and 
an  imaginary  component.  The  respective /rth  block  fre(|ucncy-domain  gradient  term  V/;|^(A) 


D-l 


is  similarly  decomposed  and  the  real  and  imaginary  kih  block  jth  gradient  terms  are  used 
to  update  the  respective  part  of  the  Hj{k)  tap.  The  expansion  of  Fi{k)  in  terms  of  the 
frequency-domain  vectors  X{k),  H(fc),  and  D(/r)  follows  the  same  development  presented  in 
.-\ppendix  B  for  WDFl.  .-Ml  time-domain  vector  notation  is  the  same.  The  frequency-domain 
vector  notation  follows  the  W’alsh-domain  vector  notation  with  the  exception  of  replacing 
the  W’  and  W“'  operator.^  with  the  corresponding  DFT  operators  T  and  .  Therefore. 
Vp,(/:)  has  the  same  general  form  as  the  Vtri(/;)  lesult  (Equation  D..5).  such  that 


Vno(A-) 

Vn(A-)  = 

= 

.v7(A-)(D,(/0-X,(A-)//,(A-)] 

1 

.  A',v_,(A-)(Av-,(A-)  -  AV_,(A-)//a:-,(A-)1 

The  forward  and  inverse  DFT  pair  used  in  the  development  is  given  by  [.5:150] 

A'„  =  f,  x.ivy 

:=0 


(D.5) 


(D.6) 


and 


where 


X,  =  l/A^  f  A'jvr 

n=0 


(D.7) 


(D.S) 


D.S  Timf-donuiirt  Gradient 

The  equivalent  time-domain  gradient  expre.ssion  for  FDFl  is  given  by 

;V-I 

V(k)  =  Y.  i  =  0. 1 . .V  -  1  (  D.9) 

1=0 


I'he  c,{k)  terms  represent  the  fth  component  of  the  time-domain  error  vector  c{k)  such  that 


c(i)  =  :r-'{E(t)) 

=  -  Uk.v)  •••  (ditjY+iY-i  -  .Vc-;V+.V-l)|^ 


D-2 


=  (eo(A:)  ...  eA’_i(/:)p 


(D.IO) 


A  brief  discussion  of  the  time-domain  output  vector  is  necessary  to  define  x,{k).  The  time 
domain  Ath  block  output  vector  is  calculated  by  performing  the  circular  convolution  of  the 
Arth  block  time-domain  weight  vector  h(A-)  and  the  A-th  block  input  vector  .\(A-).  .Accordingly, 
the  output  vector  is  defined 


where 


y(^‘) 

=  x(A-)h(A-) 

(D.ll) 

•~o(  A‘) 

•  Xi{k) 

x,(A-) 

.to(A-)  .. 

■  X2(A-) 

(D.I2) 

x,v_,(A-) 

X,V_2(A') 

.  xo(A-) 

and  x,(A-)  specifies  the  fth  value  of  x(A:)  (See  Equation  2.35)  while  x]  (k)  is  the  zth  row  of 

X(A-)- 

Using  V^(A*)  to  denote  the  jth  component  of  V(A'),  the  time  domain  weight  update 
equation  can  be  specified 

li,ik-rl)  =  hAk)  +  f,V,{k)  (D.13) 


so  that 


ko{k  T  1) 

hoik) 

^o(A-) 

-h  1) 

= 

hr(k) 

+  // 

A.v-i (A‘  -}-  I ) 

/nv-,{A-) 

.  V,v_,(A-) 

l  or  a  .Y  =  -i  block  size,  the  e.xpression  for  the  k  =  2  block  becomes 


'  /.o{3)  ■ 

'  ho{2)  ' 

Vo(2)  ■ 

/m(3) 

/„(2) 

^i(2) 

/t2(3) 

*2(2) 

V2(2) 

.  /»3(3) 

*3(2) 

V3(2) 

l)-3 


Each  gradient  term  is  calculated  using 


^j{2)  =  Ee-(2)x.(2),  j  =  0,L...,3 

t=0 


where 


Xik)  = 


c{h)  = 


Xs 

x„ 

Xio 

Xg 

X9 

xs 

Xm 

XlO 

S-IO 

X9 

xs 

Xll 

Xll 

Xio 

xg 

Xs 

(es  eg 

ClO 

eii] 

The  .To(/.-)  term  is  xg  because  h  =  2  and  N  =  -1  so  that  kN  =  S.  The  j  =  0  term  is 
Vo(2) 


[co(2)xo(2)  +  £,(2)x,(2)  +  e2(2)x2(2)  +  e3(2)x3(2)j 
(ess's  +  CgXg  +  CioXiq  +  Cii^ij] 


The  j  =  1  term  is 

Vi(2) 

Tl>«*  j  =  2  term  is 


[eo(2)x3{2)  -f  c,(2)xo(2)  +  C3(2)x,(2)  4-  e3(2)x3(2)) 

(es-T 1 1  -f  CgXs  -f  CioXg  -f  Ci  iXjo] 


^2(2)  =  (co(2)x3(2)  +  f  ,(2)x3(2)  +  C3{2)xo{2)  -f  £3(2)x,(2)j 

=  (csJ'io  4- toXij -f  Cio-r$  +  f  iixnj 


Finally,  the  j  =  3  term  is 


^3(2)  =  (^o{2)x,{2)  4-  c,(2)x2(2)  4-  C2(2)t3(2)  4-  e3(2)xo(2)) 
=  (es-To  4- £9X10  4- Cion'll  4- CiiXsj 


D-l 


(0.16) 


A  comparison  of  the  terms  calculated  above  with  similar  calculations  for  W’DFi  in 
Appendix  B  reveals  that  the  first  gradient  term  for  both  are  equal.  Subsequent  terms  have 
individual  products  that  match  products  In  corresponding  WDFl  gradient  terms. 


Appendix  E.  FDF2  Weight  Update 


This  Appendix  derives  the  FDF2  frequency-domain  gradient  vector.  An  ex'ample  is 
presented  for  the  I\  =  2  block  size.  A  FDF2  time-domain  gradient  example  is  also  presented 
for  the  block  k  =  2  using  the  block  size  N  —  A  and  is  used  to  facilitate  a  comparison  with 
FDFl. 


E.I  Frequency-Domain  Gi'adient 

The  frequency-domain  FDF2  weight  vector  is  specified  by 


Wk)  -I-  nF 


W) 

0 

0 


m)  -b  ixVr,{k) 


(E.I) 


where  F  is  the  forward  FFT  operator  and  the  vertical  vector  is  zero  padded  with  N  zeros. 
V(/r)  is  defined 

V{k)  =  first  N  terms  of  F'^  {X‘{k)E{k)}  (E.2) 

Referencing  Equations  E.I  and  E.2,  X(A-),  E(A),  and  H(A)  vector  components  are,  in  general, 
complex'  valued  quantities.  The  vector  X*(A)  is  tiie  complex  conjugate  of  X{k).  The  resul- 
tani  vertical  vector  in  Equation  E.I  defines  the  FDF2  gradient  vector  X'r2U')-  The  FDF2 
filtei  iv(|uii'es  the  use  of  2;V-poiut  tran.sforms  due  to  the  .50%  overlap  method  employed  in 
determining  the  input  vector.  Accordingly,  the  filter  uses  2N  fiequency-domain  taps  to  filter 
the  data.  In  vector  form,  the  weight  update  equation  can  be  expres.sed  as 


Hoik+l) 

Ho(k) 

^F2o(^') 

//ilA-bl) 

= 

Hdk) 

+  k 

V,-2,(A) 

H-2!\!-l{k  -f  1) 

.  Vr2.,.,(A)_ 

E-1 


Given  that  the  X(A’),  E{k),  and  H(/c)  vector  components  are  generally  complex,  the  weight 
update  equation  foi  the  jth  tap  can  be  represented  a^  two  separate  update  operations: 

Hrealj{k  +  l)  =  Hrealj{k)  +  F\realj{k)  (E-4) 

Himagji^k  -{■  1)  =  (^)  4*  (^)  (^•^) 

where  Hreatj{k)  and  H,mag,{k)  represent  the  real  and  imaginary  parts  of  Hj{k).  The  terms 
^Fireaij{f^)  ^^id  V Fi,magj{k)  represent  the  real  and  imaginary  parts  of  Vfi^{k).  Therefore, 
during  the  A'th  block  each  frequency-domain  tap  is  decomposed  into  a  real  component  and 
an  imaginary  component.  The  respective  kih  block  frequency-domain  gradient  term  V f2j{^') 
is  similarly  decomposed  and  the  real  and  imaginary  kHi  block  jth  gradient  terms  are  used 
to  update  the  respective  part  of  the  Hj{k)  tap. 

At  this  point  we  begin  the  F2{k)  derivation  by  defining  the  kth  block  FDF2  time- 
domain  input  vector  x{k).  Using  the  notation  x,  to  represent  the  input  sequence,  the  N  input 
sequence  values  which  define  the  kth  input  block  can  be  represented  by  XkF!+,,  where  i  = 
0, 1, . . . ,  1.  Next,  the  N-point  previous  block  and  N-point  current  block  are  concatenated 

to  produce  the  kth  block  input  vector,  defined  as 

x{k)  =  ...  X(jtAf-i)  ^{kN)  a;(jtAf+N-i)]  (E-6) 

' - - /  ' - - / 

{k~'l)th  block  kill  block 

The  A;th  block  input  transform  matrix  X{k)  is  gi\en  by 


X(k)  =  diag{J^[x{i;N-f^)  ...  X(a-n-i)  x^kN)  Jq^/V+N-i)]} 


{k-l)th  block 


kth  block 


where  is  the  forward  DFT  operator.  The  forward  and  inverse  2A'-point  DFT  pair  is 
defined  [5:150] 

2A'-1 

,Y,  =  (E-S) 


where 


2^-1 

li  =  l/2iV  Y: 

Tl  =  0 


(E.IO) 


Representing  the  DFT  transform  components  of  the  2A^-point  A'th  block  input  vector  as 
X„{k),  X(A:)  can  be  expressed  as 


The  T  *  operator  used  in  Equation  E.14  is  the  inverse  DFT  operator.  Using  the  inverse 
DFT  sum  (Equation  E.9),  the  y{k)  vector  can  be  expressed  as 


ykN 

Zlio' 

y(*)  =  sv 

ykN+\ 

= 

VkN+N-l 

i;“o A'„(t')tf„(*i) 

The  frequency-domain  error  vector  E(/r)  for  the  kth  block  is  defined  by 


E{k)  =  .^{(P  0,  id(hN)  -  y(hN)) 

N  zeros 


•  •  •  -  y{kN+N~\))V} 

kth  error  block 


(E.16) 


where  the  d^kN+i)  terms  represent  the  kth  A^-point  desired  sequence  block.  Using  the  linear 
property  of  the  DFT,  Equation  E.16  can  be  expressed  as 


E{k)  =  J^{[P  .^.  0,  d^kN)  •••  d^kN+N-i)?] 

N  zeros  • 

~.r{[p  0^  y(kN)  •••  y(kN+N-i)V] 

II  I  I 

N  zeros 

=  E,{k)-FMk)  (E.17) 


Evaluation  of 

E2(4-)  =  .7^{[P  .^.  0^  ...  7/(t.\r+;Y_l)F} 

N  zeros 

using  Equations  E.Sand  E.1-5  produces  the  vector 


E,{k)  = 


1 

2N 


EL^aT' 

zllo'  wiir'hv-^\x„{k)iUk) 


(E.IS) 


(E.19) 


E-4 


The  rth  component  of  Equation  E.19  can  be  expressed  as 


2N-1  2A'-1 

=  1/2A'  E  E  r  =  0. 1. . . . .  2«  -  1  (E.20) 

t=N  n=0 

Evaluation  of 

Ei(^-)  =  0^  d(;t;V)  d(kN+N-\)V  (E.21) 

N  zeros 

produces 

2^-1 

E,,(A')=1/2A^  ^  r  =  0,l,...,2A^-l  (E.22) 

i=N 

such  that 

X*(/c)E(A)  =  X‘{k)E,{k)  -  X'{k)E2ik)  (E.23) 

At  this  time,  the  inverse  DFT  is  performed  on  Equation  E.23.  Taking  the  inverse  DFT 
of  the  product  involving  Ei{k)  produces 


2iV-l 

V,,(«:)  =  1/2A'  E  EUk).K{k)WS’’  (E.24) 

r=0 

Substituting  the  result  from  Equation  E.22  for  E^j{k)  gives 

2;V-1  2A'-1 

V,,(A-)  =  1/2A'  E  E  M'm’'' (E.2o) 

r=0  :=A' 

where  p  =  0, 1, . . . .  2N  —  1.  Taking  the  inverse  DFT  of  the  product  involving  E2{k)  produces 

2  A' -I 

V2,(A)  =  l/2.'V  E  E,,{k)X;(k)\V,-;;"  (E.26) 

r=:0 


and  substitution  of  the  result  from  Equation  E.20  for  E2^ik)  yields 

2A'-1  2A’-1  2A-1 

V2„(A)  =  (1/2A0’  E  E  E  M'2K'1T7H'2K"A';(A)A'.(A)//.(t)  (E.27) 

r=0  1=N  >1=0 


where  p  =  0, 1,. . .  ,2A^  -  1.  The  next  step  in  deriving  X’ P2{k)  is  to  replace  the  last  N  values 
of  '^2{k)  and  V,(A-)  with  zeros  and  forwaid  trau-sform  the  resulting  vcctor.s  to  produce  two 


frequency-domain  vectors:  identified  as  ^ *  ^F2i(^)  respectively.  F2{k)  is  defined 
by  the  difference  of  the  resulting  frequency-domain  vectors: 


^F2{k)=\^F2Af^)-^F2M 


(E.2S) 


which  can  be  e.xpressed  as 


N-l  2N-1  2N-1 

v„.(*)  =  1/2A'-  E  E  E 

p=0  r=0  1=N 

/V-1  2A^-1  2/V-!2A'-1 

-(I/2A')"  E  E  E  E 

p=0  r=0  t=iV'  n=0 

q  =  1  (E.29) 


This  is  the  solution  presented  in  Chapter  II. 


E-C) 


For  N  =  2  the  frequency-domain  gradient  real  and  imaginary  (j)  terms  are  as  follows; 


=  (<<,24/4)12A'o-(i)-A7(fc)(H-j)-A'^(t-)(l-j)l 

-  A', ■(*)(!  -j)-  A'3-(/.-)(1  +i)| 

-|A'„(*)r//o(A,')  -  (l/2)|A',(A-)pW,(J;)(l  +  j) 

-(l/2)|A3(A)p;/3(A)(l  -j)  +  (l/2)X„(l:)X;(t)Ho(t) 
+(l/2)A'„(t)X, ■(;■)//„(*)  +  (1/2)A'„'(A)A',;A)77,(A-)(1  +j) 
+U/2}X:(k)X,(i:)H2(l:)  -  UI2)X-,(k)X,il.-)N2{l.-) 
Mll2)X;{k)X,(k)IMh)(l  -j) 


Vr.W  =  M2i)/4)|A'„-(A)(l-j)-2A',-(A)  +  A'3(t)(l+j)l 

+(<i(2«.)/4)lA'„-(A)(l  -j)-  X;{k)(l  -j)+  2jX;(k}\ 
-|A',(A)p//,(i-)  -  (l/2)|A'„(A)p//„(A)(l  -j) 
-(l/2)lA2(A)Pft(A)(l  -i  j)  +  (l/2)A'o(A)A';(A)«„(A-){i  -  ;) 
+(i/2)x;(A)A',(A')k,(a;  +  (i/2)A'2-(A)a',(a-)//,(A') 
+(1/2)A',-(A)A'2(A-)W2(A)'1 +2) 

-072)A'„-(a-)A'3(A')a/3(a-)  +  (j72)A':(a-)A',(a-)//3(A-) 


Vf2,(A-)  =  (rf,2n/4)(-A'r(A-)(l  -j)  +  2A7(A-)-A'3-(A-)(l+j)) 

H'(^^(2t+i)/4}[-2A2(A‘)  +  A,"{A-){1  +a)  +  A3(A:)(1  -j)) 
-iA-2(A)P//2(A-)  -  (l/2)|A,(A.,p;/,{A-)(l  -  j) 
-(l/2)|A3(A-)p//,.(A-)(l+j)  +  (l/2)A-2(A)A7(A-);/2(A') 
+(I/2)A'3(A-)A'2(A-)//2{/.-)-  •.,'2)A7.;A)V,;A-)f;,(A-)(l-.j) 
+(I/2)A',-(A')A'3(A-)//o(A')(I+j) 

-0/2)A'r(A-)A'„(A-)//„{A-)  +  072)A'3-(A-)A'„(A-)//o(A7 


Vf2.(A-)  =  (W4)|A'o-(A')(l+j)  +  2A'J(A)(I-:,')-2A'3-(A-)l 

+(<'i2W.)/4)(A'„-(A-)'1  +  j)  -  A',-W(l  -j)  -  2jXm] 

-|A'3(A-)P//3(A)  -  ,!  2  -  +  j) 

-(i/2)|A'3(,  )p;-.  -I-  (i/2)a'o(a-)a'3(a-)/a„(*)(i  + ,/) 

+(l/2)AJ(A-)A'3(A,A,-,;){i -j)  i- (1/2)A';(A-)A-3(A-)//3(A-) 
+(1/2)A'3-(A')A'3(A-);,  (A-) 

+072)A'„-(A')A,(A-)J-.-  .■)  -  {j;2]XiH:]X,{k)H,(k) 


E.2  Time-domain  Gradient 

The  equivalent  time-domain  gradient  expression  for  FDF2  is  given  by 

2A'-1 

=  Y1  e,(A').T(, i  =  1  (E.30) 

:=A' 

where  j  is  the  time-domain  weight  index  and  V_,(A-)  defines  the  A-lh  Mock  gradient  term,  for 
each  time-domain  weight.  The  x,{k)  and  c,(A')  terms  repjes^nt  the  ?th  component  of  \{k) 
and  e(A-)  rejp-^ctively,  in  thr  A'th  block: 

X(k)  =  [xihN-.K)  -'’■'{hN-i)  •'C(A-A’)  ...  ■r(A;A'-  +  3V-l)) 

^  ^  ^  >■ 

[h—\)th  block  ktk  block 

=  [.To(/M  ...  .T(2A'-i)(a-))  (E..3I) 

and 

e(A-)  =  (P  .  ^ .  0,  {d{i;\-)  -  !/{^;^'))  ■■■  -  y[hs+.\--]))}' 

^  error  bluch 

=  [coik)  ...  r,2.v_,)(A-))^  (E.32) 

Using  Vj(A'),  the  time-domain  weight  update  equation  can  be  spfcified 


h,(k+\)  =  h,(k)  +  ,t\>’,{k) 


so  that 


lio{k  +  1) 

hoik) 

Vo(A-) 

hilk  +  \) 

= 

lh{k) 

+  u 

V,{k) 

hi\--]{k  -i-  !  j 

_  h^-iik) 

For  a  N  =  4  block  size,  the  expression  for  the  k  =  2  biock  becomes 


'  /io(3)  ‘ 

'  ko{-2)  ' 

’  V„(2)  ■ 

'm(3) 

= 

+  /< 

V,(2)  i 

//3(3) 

113(2) 

.  V3(2)  j 

Each  gradient  term  is  calculated  using 

V,(2)  =  i;c,(2)=:|,-.fl(2),  j=0,l . .3 

I='l 

where 

\{k)  -  [.r.,  .rs  .re  .I'r  Xs  Xq  .t,o  .Tnj 
e(A')  =  [0  0  0  0  Cs  eg  cio  Cnj 


(E.34) 


(E.36) 


since  N  =  4,  k  =  2.  and  therefore  the  x(A-)  index  {kN  —  N  +  i)  equals  (4  +  i)  and  the  e{!r 
ind>*.'.  for  the  last  /V  values.  {kN  +  /).  equals  (8  +  ?). 

E.xchuling  the  zero  valued  products  in  each  sum.  the  time-domain  giadient  terms  are 
as  follows: 

the  i  =  0  term  is 

Vo(2)  =  [c.,(2).r.,(2)  4-  e5(2)r5(2)  -1-  C6(2).r6(2)  -f  e-(2).r7(2)] 

=  [e8.Tg  -f  Cg.rg  -f  eio-Tio  +  Cn-rii) 


The  i  =  1  term  is 


V,(2)  =  (64(2)0:3(2) +  e5(2)x,, (2) +  e6(2)rr5(2)  +  e7(2K^^^^ 

=  [csa-’?  +  egXg  T  +  Cii-Tio) 

The  j  =  2  term  is 

'^2(2)  =•  [e4(2)x2(2)  +  e5\^2)x3(2)  +  e6(2)x4(2)  +  e7(2).T  5(2)] 

=  [cs-xe  +  69X7  +  fiioXs  +  611X9] 

Finally,  the  j  =  3  term  is 


V3(2) 


(e.(2)r,{2)  !  C5(2)x2(2)  +  e6(2).X3(2)  +  e7(2)x4(2)] 
(cs-Ts  -f  69X',  i-  6)0X7  +  CiiXs] 


In  comparison  to  the  FDFl  time-domain  gradient  terms  (Appendix  C),  the  FDF2  time- 
domain  gradient  terms  above  are  the  cross-correlation  of  x(A')  and  e{k).  Since  the  FDFl  filter 
performs  circular  convolution,  the  gradient  terms  are  i  a!  ulated  using  the  product  of  e(A’) 
and  the  corresponding  column  of  the  kth  block  circulant  matrix. 


K-iO 


Appendix  F.  Program  Listings 


WDFl  Filter  Listing 

This  is  the  Turbo  Pascal  6.0  listing  of  the  WDFl  program. 


Program  WDFl; 

{$N+} 

Uses  Printer, CRT, DOS; 

CONST 

N=8;  (***  N  is  block  size*) 

P=3;  (*  N=2**P  *) 

datasize=1000 ; 

Misadjust=0, 1 ; 

TYPE 

RealArrayN2=ARRAY[0. . (N-1)]  of  real; 

InputArray=ARRAY[0. .datasize-1]  of  real; 

Output Array=ARRAY [0. .datasize-l]  of  real; 
FArray=ARRAYCO..P,l..N,O..N-l]  of  Real; 

VAR 

hr,m,s ,sl00:Word; 

StartClock , StopClock : Real ; 
data ; Real ArrayN2 ; 

F:FArray ; 

gain.mu , Pbin , X , H , W , ERR , V2 , input_block , grad , D , Yw : RealArrayN2 ; 

desired , input : Input Array ; 

error , y : OutputArray ; 

isign ,  nn ,  Block_nuin ,  k :  integer ; 

mu: real ; 

inf ile,desiredf ile.errorfile, outfile,weightO : text ; 
weight 1 , weight2 , weights , ueightd : text ; 


(♦  Procedure  Init_var  *) 
(*  *) 
(*  This  procedure  initializes  all  variables.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


^  jfe  1 4c  4c  4c  ifc  4c  *  *  *  *  :<(  *  *  4c  :4c  4c  *  4^  *  3f:  4c  *  %  4c  4c  1c  4c  4c  4c  :|c  ifc  3^  :4c  4c  ifc  4=  :4c  4c  4c  *  *  *  *  *  4c  Jte  *  *  3tc  :4c  lie ) 


Procedure  Init_var: 

Var 

l,j ,i:integer: 

Begin 

Block_num:=0; 

For  j:=0  to  datasize-1  Do 
Begin 

error  [j] :=0: 
desiredCj] :=0: 
input [j] :=0; 
y[j]:=0; 

End; 

For  j:=0  to  (N-1)  Do 
Begin 
XCj]:=0: 

WCj]:=0; 

H[j]  :=0; 

ERRCj] :=0; 

V2[j]:=0; 

input.blockCj] :=0; 
gradCj] :=0; 
gain.muCj] :=0; 
PbinCj]  :=0; 

DCj]:=0: 

Yw[j]  :=0; 

End; 

For  j :=0  to  P  Do 
For  i :=1  to  N  Do 
For  1:=0  to  N-1  Do 
F[j,i,l] :=0; 


End; 

(^^:*if**********************************************************) 


(*  Procedure  Open  input  files  ♦) 
(*  *) 
(*  Called  By:  ♦) 
(*  Main  Program  ♦) 
(*  Routines  Called:  None  ♦) 


Procedure  Open_input_f iles; 
Begin 


F-2 


AssignCinfile,  ’B:tstinpt2.Dat’) ; 
Assign(desiredf ile,  ’B:tstdes2.Dat’ ) ; 
Reset(infile) ; 

Reset (desiredf ile) ; 

End; 


(*  Procedure  Open  output  files  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  ♦) 


(^***iilf^ilt^:ilHtHt:t*m*****^***************:****i***m*:*********:*****m******y 

Procedure  Open_output_f iles ; 

Begin 

Assign(errorf ile,  ’B:Error.Dat’) ; 

Rewrite(errorf ile) ; 

Assign(outf ile,  ’B:0ut.Dat’) ; 

RewriteCoutf ile) ; 

End; 

(«*4[**:*«**  *»4l4::»««*«*«***»»***«*»*4t*«4:*4t»4:;r**4E**#****»*4l******) 


(*  Procedure  Close  input  files  *) 
(*  *) 
(♦  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


(^**m*********************************ii*****»***********T^******') 

Procedure  Close_input_f iles ; 

Begin 

CloseCinf ile) ; 

Close(desiredf ile) ; 

End; 

(^i^t^^m***********»***»**^**»***»*******w****»**  **»»»»****•*»*•') 


(♦  Procedure  Close  output  files  •) 
(♦  *) 
(*  Called  By:  ») 
(♦  Main  Program  •) 
(*  Routines  Called:  None  •) 


(***«***:»****************•«****#*•••***♦•****••*****##*•*•***•) 

Procedure  Close_output_f iles ; 


Begin 

Close (errcrfile) ; 
Close(outf ile)  ; 
End; 


(»♦**»♦»♦♦**♦♦♦♦*»***♦♦*♦♦**♦**♦*♦♦♦*»*»♦»**»»**♦♦♦♦*♦*•♦***♦•*) 

Procedure  ClockOn;  , 

Begin 

GetTinie(hr,ni,s,slOO) ; 

StartClock : = (hr*3600) + (ni*60)+s+(s  100/ 100) ; 

End; 

(**********«*****♦**********»*****«*********•**»********•** 

Procedure  ClockOff; 

Begin 

GetTiDe(hr,m,s,slOO) ; 

StopClock : = (hr*3600) + (n2*60) +s+ (slOO/ 100) : 

WriteLnC ’Elapsed  tine  =  ’ , (StopClock-StartCiock) :0:2) ; 

End; 


(*»^**m*»m****»»***»********»»******9**m*»*»**»***»*»***»*0t»»») 


(*  Procedure  Calc.nusblocks  ») 
(*  *) 
(*  This  procedure  calculates  the  nusber  of  blocks  to  *) 
(*  be  processed.  *) 
(•  •) 
(♦  Called  By:  ») 
(*  Main  Progran  •) 
{•  Routines  Called:  Hone  ») 


Procedure  Calc.nunblocks ; 
Begin 

Block_nun:=datasi2e  div  N; 
End; 


(•  Procedure  Waltran  ») 
(•  •) 
(•  This  procedure  perforos  the  forward  and  in^'erse  M-point  ») 
(♦  Fast  Walsh  Transfom  (FVT).  This  routine  calculates  ♦) 
(•  the  forward  and  inverse  transfoms  using  the  sane  loop:  •) 
(•  the  forward  transforr:  requires  the  loop  result  to  be  •) 
(»  sultiplied  by  a  factor  of  l/(?l) .  ») 


(*  The  algorithm  is  recursive  and  requires  P  stages,  where  >•') 
(*  N=2**P.  This  routine  requires  no  multiplications  *) 
(*  and  NLog(N)  summations,  where  the  logarithm  is  base  2.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Procedure  Past_Current_Block  *) 
(*  Procedure  Calculate.y  *) 
(*  Procedure  Calculate_error  *) 
(*  Procedure  Calculato.Gradient  *) 
(*  Procedure  Update_Weights  *) 
(*  Routines  Called:  *) 
(*  None  *) 
(*  Variables:  *) 
(*  P:  N=2**P  *) 
(*  isign  :  indicates  inverse  or  forward  transform  *) 
(*  dataCj]  :  input  and  output'  *) 
(*  F[P,l,j]  :Fast  Walsh  Matrix  result  *) 
(*  j=0,l,,.2N-l  *) 


(  41 1  #  >l<  it!  ^  If:  ^  !<<  4:  >l<  4:  %  4:  ^  ^  %  ><<  It:  >l<  if:  *  %  4:  !|<  ) 

(:t:><(ltC>|c:|c:|<>t<>t!lt<%’t!l|<lt!lt‘>t!lt<lt<lt<lt!lt!lt!>|!lt!ltl>l<lt!lt‘lt:it<lt<lt‘>l‘lt<>t<>t<lt!lt‘’t!lt!’t!l|<l|<>l<lt=>l<>t!lt!:t!lt!ltt:t!lt<l|!>|!lt<lt!lt!lt!lt!lf<l|!lt!lt<l|<’i<  ) 

Procedure  Waltrau; 

Var 

j , 1 , i , j  max , Imax , exponent : int  eger ; 
j log, jinv: real; 

Begin 

For  1:=1  to  N  Do 
Begin 

F[0,1,0] :=data[l-l] ; 

(*  WriteLn(Lst,  ’  F(’ ,0,1,0, ’)=  ’,FC0,1,0]);  *) 

End; 

For  i:=0  to  P-1  Do 
Begin 

jlog:=(i+l)*Ln(2) ; 
jinv:=Exp(jlog) ; 
j  max : =Round (jinv); 

(*  WriteLn(Lst,  ’jmax=  ’,  jmax) ;  *) 
lmax:=N  Div  jmax; 

(*  WriteLn(Lst,  ’  kmax=  ’,  kmax) ;  *) 

For  1:=1  to  Imax  Do 
Begin 

For  j:=0  to  jmax-1  Do 
Begin 

exponent :=(j+l)  Div  2; 
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If  Odd (exponent)  then 

FCi+l,l,j] :=F[i, 2*1-1, (j  Div  2)] 

-F[i,2*l,(j  Div  2)] 

else 

F[i+l,l,j] :=F[i, 2*1-1, (j  Div  2)] 

+F[i,2*l,(j  Div  2)]; 

End; 

End; 

End; 

For  j :=0  co  (N-1)  Do 
Begin 

if  isign=-l  then 
dataCj] :=F[P,l,j] 
else 

dataCj] :=(l/N)*FCF,l,j] ; 

End; 

End; 

(*  Procedure  Prepare_input_block_for_Waltran  *) 

(*  *) 

(*  This  routine  enters  the  data  values  into  data[j]  in  *) 

(*  preparation  for  forward  or  inverse  DWT.  *) 

(*  *) 

(*  Called  By:  *) 

(*  Procedure  Past_Current_Block  *) 

(*  Procedure  Calculate_y  *) 

(*  Procedure  Calculate_error  *) 

(*  Procedure  Calculate.Gradient  *) 

(*  Procedure  Update_weights  *) 

(*  Routines  Called:  None  *) 

Procedure  Prepare_input_block_f or.Waltran ; 

Var 

j : integer; 

Begin 

if  isign  =1  then 
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For  j :=0  to  (N-1)  Do 
begin 

data[j] :=input_block[j] ; 
end; 

if  isign  =-l  then 

For  j :=0  to  (N-1)  Do 
begin 

data[j]  :=V2[j]  ; 
end; 

End; 


(*♦**)*:!(<**********  j|C****!(!***j|t******itt***:)tlt;l(t)|C  He************* 


(*  Procedure  Past_Current_Block  *) 
(>t-  ♦) 
(*  This  routine  concatenates  the  current  and  previous  blocks  *) 
(*  together:  [(previous) (current)] .  Each  block  is  N  points  *) 
(*  long;  the  combination  is  2+N  points  long.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_Waltran  *) 
(*  Procedure  Waltran  *) 
(*  Variables:  *) 
(*  input_block[j]  :  (previous  blck, current  blck)  *) 


(********l(c*j(iJi<)|c******!t;**!(t***>(c!|!*>(c*******>(ci(t*)(c#*****)|c****)|cj(t:f!t;)(<**i|t!((:(t*jt:*>(;) 
(j(c********;)c**)(c*!(<**!(c**i(c*:(c)(c**Jic!t:  +  +  *jt:*Jic***j(!*)(c**)tc******!(c!(c*!)<*j(i******j|e****) 


Procedure  Current_input_block; 

Var 

j : integer ; 

Begin 

isign:=l; 

For  j :=0  to  (N-1)  Do 
Begin 

input_block[j] :=input[j+k*N] ; 

(*  WriteLn(Lst,  ’ inputblock( ’ ,  j,’)=’,  input_block[j] ) ;  *) 
End; 

Pi epare_input_block_f or.Waltran ; 

Waltran; 
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End; 

(*****«>):  ic  Di  ***  I):  If:  >|c  I):  1|C  itc  ***:):%**  :tc «« *  I|C  lie  4c  itc  !|c  >|c l|c  Itc  !f:  l|c  *  itc t  *!)<«***  ) 

(*  *) 
(*  Procedure  Current_desired_block  *) 

(  *  *  +  4:  *  4;  ifc  *  *  *  *  *  If:  *  *  %  *  *  *  *  *  *  +  *  *  *  *  4  *  *  ifc  *  4:  *  *  *  *  *  *  *  *  *  4:  *  *  *  ife  *  *  *  *  *  *  +  4  *  *  4:  ifcifc  4c  ) 

Procedure  Current_desired_block: 

Var 

j : integer; 

Begin 

isign:=l; 

For  j :=0  to  (N-1)  Do 
Begin 

input_block[j] :=desired[j+k*N]  ; 

End; 

Prepare_ input _block_for_Waltran; 

Waltran; 

For  j :=0  to  (N-1)  Do 
Begin 

D[j]  :=dataCj]  ; 

(*  WriteLnCLst,  ’  D(’,j,’)=  ’,D[j]);  *) 

End; 

End; 


(*  Procedure  Load.input  *) 
(*  *) 
(*  This  procedure  reads  in  the  input  sequence  from  a  data  *) 
(*  file.  *) 

(4=  *) 

(*  Called  By:  *) 
(*  Main  Program  *) 
(♦  Routines  Called:  None  *) 


^  4c  4c  4r  *  4c  4c  4c  4c  4: 4: 4: 4c  4c  4: 4: 4c  4: 4c  4c  4: 4c  4c  4: 4c  4c  4: 4: 4c  4c  4: 4;  4c  4c  4c  4c  4c  4c  4: 4c  4c  4c  4c  4c  4c  4c  4c  4c  4c  4: 4c  4c  4c  4c  4c  4c  4c  4c  4c  4c  4c  4c  4:  il:  4c  ^ 


Procedure  Load.input; 

Var 

j  -.integer; 

Begin 

For  j:=0  to  datasize-1  Do 
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ReadLn (infile, input  [j] ) ; 


End; 

(************>t:>(t***!|!**:t!*!t:>(!**************!|t**  +  ****i(tit:>t!**>|!!t:>t;*****!tc>t:*:>(<*) 


(*  Procedure  Load_desired  *) 
(*  *) 
(*  This  procedure  reads  in  the  desired  sequence  from  a  data  *) 
(*  file.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


*******************  ****t*******>l!*!^*****4:) 


Procedure  Load_desired; 

Var 

j: integer; 

Begin 

For  j:=0  to  datasize-1  Do 

ReadLnCdesiredfile, desired [j] ) ; 


End; 

(**********************:***4:  ******************iti**:tc***********) 


(*  Procedure  Write.output  *) 
(*  *) 
(*  This  procedure  writes  the  filter  output  and  error  *) 
(*  vectors  to  data  files.  *) 
(*  *) 
(*  Called  By:  ♦) 
(*  Main  Program  *) 
(*  Routines  Called:None  *) 


(***********************************************:ti:fc**********') 

Procedure  Write.output; 

Var 

j : integer; 

Begin 

For  j:=0  to  datasize-1  Do 
Begin 


WriteLn(outfile,y[j]) ; 

WriteLnCerrorf ile.errorCj] ) ; 

End; 

End; 

********♦**♦****♦*♦*******>!<*******♦*****) 
(*  Procedure  Diagonal_of_X  *) 

(*  *) 

(*  This  procedure  creates  the  data  vector  X.  j 

(*  The  X  data  vector  represents  the  diagonal  component  *) 

(*  of  a  diagonal  matrix  that  contains  the  DWT  of  the  *) 

(*  concatenated  previous  and  current  input  blocks.  *) 

(*  ♦) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  None  *) 

(*  Variables:  *) 

(*  X[j]  :  diagonal  values  *) 

(*  *) 


Procedure  Diagonal_of_X; 

Var 

j : integer; 
power: real; 

Begin 

For  j:=0  to  (N-1)  Do 
begin 

X[j]  :=data[j] ; 

(*  WriteLnCLst,  ’  X[’,j,  ’]  =  XCj]);  *) 

end ; 

end; 

Procedure  Calculate_avg_input_bin_pwr; 

Var 

num, j : integer; 

Begin 

num : =Block_num- 1 ; 
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For  k:=l  to  Block_num-l  Do 
Begin 

Current. input_block; 

For  j :=0  to  (N-1)  Do 
PbinCj]  :=Pbin[j]+Sqr(data[j])  ; 

End; 

For  j:=0  to  (N-1)  Do 
Begin 

PbinCj]  :  =  (l/nuin)*Pbin[j]  ; 

(*  WriteLnCLst,  ’  Pbin(’,  j,  ’)  PbinCj]);  *) 

End; 

End; 

(!(-.3(;****!(ci((!t;*****!t:jt:*****!(!*  +  *>(c***********)|c^***  ***:♦:*  *******  +  ********) 

Procedure  Calculate.mu; 

Var 

j : integer; 
avgPwrrreal; 

Begin 

avgPwr : =0 ; 

For  j :=0  to  (N-1)  Do 
Begin 

(*  gain.rauCj] :=  Misadjust/(PbinCj]+l .OE-8) ;  *) 
av  gPwr : =avgPwr+Pb inCj]*(l/N); 

End; 

(*  gain_muC6] :=gain_muC7] ;  *) 

mu : =Misad just/avgPwr ; 

(*  WriteLndst,  ’  gain  constant  mu  =  ’ ,  mu);  *) 

(*  WriteLn(Lst,  ’  average  power  =  ’,avgPwr);  *) 

End; 


(*j|t*j(t*****:(c**>)c*i(t:)t)(t:(t****!t:**>(c***!f»*******************)|t****>tt**.1c!f!(t**) 


(*  Procedure  Perform_Matrix_Multiply 

(* 

(*  Multiplies  a  2Nx2N  matrix  by  a  2Nxl  dimension  vector. 

(*  The  matrix  in  all  cases  is  a  diagonal  matrix  so  the 

(*  routine  automatically  ignores  the  off  diagonal  terms 

(*  during  the  multiplication. 

(♦ 

(*  Called  By: 

(*  Procedure  Calculate.y 


*) 

<•) 

*) 

♦) 

*) 

♦) 

*) 

*) 

*) 
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(*  Procedure  Calculate.Gradient  *) 
(*  Routines  Called:  None  *) 
(*  Variables:  *) 
(*  V2[j]  :  the  resulting  2Nxl  vect</':  *) 
(*  *) 


(*j(!****!(c*j(c**<;*******Jt'*f=l‘*****!*:itt**)(: ***=!!**>*' :<♦********************) 

Procedure  Perf orm_Matrix_Multiply (var  M,V:  RealArrayN2) ; 


Var 

j : integer ; 

Begin 

For  j ;=0  to  (N-1)  Do 
Begin 

V2Cj]:=MCj]*VCj]; 

End ; 

End; 

(^^iH:ifJifilfHi^cit:itt^t^:^!ilf*Jtt^!ilf*****-i'*********************t*****************) 


(*  Procedure  Calculate.y  *) 
(*  *) 
(*  This  procedure  calculates  the  output  sequence  values  *) 
(*  for  the  current  block  being  processed.  The  output  is  *) 
(*  equal  to  the  last  N  tenrs  of  the  inverse  DWT  of  the  *) 
(*  product  of  X  and  the  wal.sh  domain  weight  vector.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Waltran  *) 
(*  Procedure  Prepare_input_block_for_Waltran  *) 
(*  Procedure  Perform_Matrix_Multiply  *) 
(*  Variables:  *) 
(*  y[j]  :  filter  output  *) 
(*  *) 


(**j(t**l*:Jt::tr*****!t:lt!*******)t;**4:**!(c***Hc!(t******1t**^!|c***)H(C!(c***********) 

Procedure  Calculate.y; 

Var 

j : integer: 


Begin 


Perform_Matrix_Multiply(X,H)  ; 

For  j:=0  to  (N-1)  Do 
YwCj]:=V2[j]; 

isign:=-l; 

Prepare. input_block_f or_Waltran; 

Waltran; 

For  j:=0  to  N-1  Do 
Begin 

yCk*N+j] :=data[j3 ; 

(*  WriteLn(Lst,  '  y( ’ ,k*N+j , ’ )=  ’,yCk*N+j3);  *) 

End; 

End; 

(-  Procedure  Calculate.error  *) 

*) 

(.*  This  procedure  calculates  the  error  sequence  values  for  *) 
(*  the  current  block  and  the  complex  error  vector.  *) 

(t  The  error  block  for  the  current  inp"t  *) 

(*  block  equals  the  current  desired  block  minus  the  output  *) 
(*  for  the  current  input  block.  The  error  vector  *) 

(*  ERR[j] ,  equals  the  FFT  of  the  zero  padded  error  block:  *) 

(*  DWT[N  zeros,  error  block].  *) 

(*  *) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  *) 

(*  Procedure  Prepare_input_block_f or .Waltran  *) 

(*  Procedure  Waltran  ♦) 

(*  Variables:  *) 

(*  ERR[j]  :  the  DWT  of  the  error  sequence  *) 

(*  for  the  current  block  f) 

(*  *) 

(^*****t*******************t*****************1r  *******************) 


Procedure  Calculate.error; 

Var 

j : integer ; 

Begin 

For  j '=0  to  N-1  Do 
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begin 

ERRfj]  :=DCj]-YuLj] ; 

V2Cj]:=ERRCj]; 

end; 

isign:=-l; 

Prepare_input_block_for_Waltrari; 

Waltran; 

For  j :=0  to  (N-1)  Do 
begin 

error Ck*N+j] :=dataCj] ; 

(*  WriteLn(Lst,  ’  e(’ ,k*N+j , ,  error [k*N+j] ) ;  *) 

end; 

End; 

(******>****♦**♦***  V(c**l|c****l(;****l|t***ltt*****l|t*J(c*:j:  *♦**  +  *♦♦******) 

(*  Procedure  Calculate_Gradient  *) 

(*  *) 

(*  This  procedure  calculates  the  gradient  sequence  for  the  *) 

(t  current  block  being  processed.  The  gradient  sequence  *) 

(*  equals  the  first  N  terms  of  the  inverse  DWTT  of  the  *) 

(*  product  of  X  and  the  error  vector  E.  *) 

(*  *) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  ■^) 

(*  Procedure  Perfoi7n_Matrix_Multiply  *) 

(*  Procedure  Prep?' e_input_block_for_Waltran  *) 

{*  Procedure  Waltrzn  *) 

(*  Variables:  *) 

(*  gradCj] :walsh-domain  gradient  vector  for  block  k  *) 

(*  Tgradfj]:  t:r/ -domain  gradient  vector  for  block  k  *) 

(*  *) 


Procedure  Calculate.Gradient ; 
Var 

j: integer; 

Tgrad : Real ArrayN2 ; 

Begin 


Perform_Matrix_Hultiply(X,ERR) ; 
For  j:=0  to  (N-1)  Do 


Begin 

gradCj]  :=V2Cj]  ; 

(*  WriteLn(Lst,  ’  Grad(’,  j,  ’)=  grad[j]):  *) 

End; 

isign:=-l; 

Prepare. input_block_for_Waltran; 

Waltran; 

For  j :=0  to  (N-1)  Do 
Begin 

TgradCj] :=data[j] ; 

(*  WriteLndst,  ’  grad(’,j,’)=  ’,Tgrad[j]);  *) 

End ; 

End; 

( :tc  4: 4:  itc  :|c  :|i It:  :|c  I):  4:  ^  If:  4: 1):  4:  *  ^  *  4: >•<  l|<  ^  #  ^4:  It:  :|c  ^ ^  ^  ^  ) 

(*  Procedure  Update.weights  *) 

(*  *) 

(*  This  procedure  updates  the  filters  tap  weights.  The  *) 

(*  new  weights  equal  the  old  weights  plus  the  product  of  the  *) 

(*  gain  constant  and  the  gradient  vector.  The  ♦) 

(*  gradient  vector  equals  the  DWT  of  the  gradient  ♦) 

(*  sequence  padded  with  N  zeros:  DWT[(grad  seq) ,  N  zeros].  *) 

(♦  *) 

(*  Called  By:  *) 

(*  Main  Progiam  *) 

(*  Routines  Called:  *) 

(♦  Procedure  Prepare. input_block_for_Waltran  *) 

(*  Procedure  Waltran  *) 

(♦  Variables:  *) 

(*  H[j]  :  Walsh  domain  weight  vector  *) 

(4c4<4:4i4'4i4i4‘4i4i4i4t4i4i4:4:4i4i4i4:4:4i4:4i4i4:4:4:4:4t4i4:*4i**4c*4t4c4;.»4i4i4t4c4i4i4i4'4i*4<4i4***4c4t*4i4t) 


Procedure  Update.weights ; 

Var 

tap, j : integer; 

Begin 

For  tap:=0  to  (N-1)  Do 
begin 

H[tap]  :=HCtap]+rau*grad  [tap]  ; 
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WriteLn(Lst,  ’  H(’,  tap,  ’)=  H[tap]);  *) 


(* 


end; 


End; 

( ^  *  If:  ^  If  *  If:  %  ^  It:  i|i *  I):  ^  ^  4:  :|c  ^  ^  %  :4c  ifc  t  It:  It: ^  If: ) 

(*  Procedure  time_domain_wts  *) 

(****lfl|c****lt:***i|c*ic**i|ci|ci|c***l|c****l|:i|:if:i|c:t:lf***it:fi|:>|:lf*l|:*f*i|:**if:i|c***i|c**f*) 


Procedure  time_domain_wts ; 

Var 

j : integer; 

Begin 

For  j :=0  to  (N-1)  Do 
Begin 

V2Cj]:=HCj]; 

(*  WriteLndst,  =  H[j]);  *) 

End; 

isign:=-l; 

Prepare. input_block_for_Waltran; 

Waltran; 

(*  WriteLn(Lst,  ’  Block  ’ ,  k) ;  *) 

For  j:=0  to  (N-1)  Do 
Begin 

W[j]  :=data[j]  ; 

(*  WriteLnCLst,  ’  W(’,  j,  WCj]);  ♦) 

End; 


End; 


( If  *  If  If  *  If  If  f  If  t  If  If  f  If  If  f  *  *  *  If  *  If  If  If  If  If  4:  If  f  If  If  f  *  *  *  If  *  *  If  If  If  f  f  If  *  If  If  *  If  If  ♦  f  f  f  If  If  If  f  If  If  f  « ) 

(*  Procedure  Set.weights  ♦) 

(« If  If  If  If  If  f  If  If  If  If  If  If  If  If  If  f  If  41  If  If  If  4:  If  If  If  If  If  If  If  t  if  f  If  If  If  If  If  f  f  If  *  f  If  If  If -f  If  If  *  If  f  If  If  f  f  If  If  f  t ) 


Procedure  Set.weights; 

Var 

j  : integer; 

Begin 

WCO] : =48. 4796; 

WCl] : =5. 6844; 

WC2] : =5. 0732; 

W[3] : =10. 7032; 

For  j :=0  to  (N-1)  Do 
input_block[j] :=W[j] ; 
isign:=l ; 

Prepare. input_block_for_Waltran; 
Waltran; 


For  j:=0  to  (N-1)  Do 
H[j]  :=data[j]  ; 

End; 

(  * DC  *  :4c  :|c  4:  ♦ :4c  «  4:  *  * :):  *  *  41  :tc  4:  :tc Ik 1)1  *  *  4: « 3)1 «  «  *  «  *  «  4:  :|c  ^  *  *  *  «  ) 

(DcDcDcDc^DcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDc  Main  Program  DcDcDc  +  DcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDcDDcDc) 

(  DC  4  Dc  DC  Ik  DC  D<  DC  DC  4  DC  DC  DC  DC  DC  4  34c  DC  DC  DC  Dc  DC  DC  DC  DC  :4c  D<  DC  DC  DC  Dc  DC  Dc  DC  DC  DC  4  DC  :4c  DC  4c  DC  4  4  D<  DC  DC  DC  Ik  DC  DC  DC  4  DC  DC  DC  DC  34c  D:  DC  4  DC  4  DC  4  ) 


Begin 

Onen_input_f iles ; 

Open_output_f iles ; 

Init_var; 

Load.input; 

Load_desired; 

(*  ClockOn;  dc) 

Calc_numblocks ; 
Calculate_avg_input_bin_pwr ; 
Calculate_mu; 

(*  Set.weights;  *) 

For  k:=0  to  Block_num-l  Do 
Begin 

WriteLnC  ’  processing  block’ ,  k) ; 
Current _ input_block ; 

Diagonal_of_X; 

Current _desired_block ; 

Calculate_y ; 

Calculate.error ; 

Calculate_gradient ; 

Update_weights ; 

(♦  time_domain_wts;  4) 
end; 

(*  time_domain_wts ;  4) 

Write_output; 

Close_input_f iles ; 

Close.output.f iles ; 

End. 
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WDFS  Filler  Listing 

This  is  the  Turbo  Pascal  6.0  listing  of  the  WDF2  program. 


Program  KDF2; 

Uses  Printer, CRT, DOS; 

COHST 

H=8;  (*♦♦  M  is  block  size*) 

datasize=1000; 

Kisadjust=0.1; 

P=4;  (*  2H=2**P  •) 

•n'PE 

RealArrayH2=ARRAY[0..(2*H)-l]  of  real; 

InputArray=ARRAY[0. -catasize-l]  of  real; 

Output Array=ARRAY [0. .datasize-l]  of  real; 
FArray=ARRAYCC.,?,l..(2*K),0..(2*IJ-i)3  of  Real; 

VAR 

hr,n,s,slOO:Word; 

StartClock ,StopClock : Real ; 
data : Real ArrayN2 ; 

F:FArray; 

gain.Eu , Pbin , X , H , W , ERR ,  Y2 , input_block , grad : Real ArrayK2 ; 

desired , input : Input Array ; 

error , y ; Output Array ; 

isign , nn , Block.nun , k : integer ; 

nu : real ; 

infile , desiredf ile , errorf ile ,outf ile .seightO : text ; 

we  ight 1 , we ight2 , we ightS , weight4 , weights , we ightS , weight  7 : tex t ; 


(*  Procedure  Init_var  ♦) 
(♦  •) 
(*  This  procedure  initializes  ail  variables.  *) 
(*  *) 
(♦  Called  By:  *) 


(•  M»in  Program  *) 

(•  Routines  Called:  None  •) 

(»*»**•*••«•*••*•*•••**•*••••*«•••••••••••»•••••«*»•••••••••••») 

Procedure  Init.var; 

Var 

l,j ,i:integer; 


F  iS 


Begin 


Block_nuin:=0; 

For  j:=0  to  datasize-1  Do 
Begin 

error  [j] :=0; 
desired [j] :=0; 
input [j] :=0; 

y[j]:=o; 


End; 

For  j:=0  to  (2*N)-1  Do 
Begin 
XCj]:=0; 

WCj]:=0: 

HCj]:=0; 

ERRCj]:=0; 

V2Cj]:=0; 

input_block[j] 0; 
gradCj] :=0; 
gain_mu[j] :=0; 
PbinCj] :=0; 


End; 

For  j:=0  to  P  Do 

For  i:=l  to  (2*N)  Do 
For  1:=0  to  (2*N-1)  Do 
FCj,i,l]:=0; 


End; 


(♦♦♦♦♦He********************************************!*;***!):******) 


(*  Procedure  Open  input  files  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


Procedure  Cpen_input_f iles ; 

Begin 

Assign(inf ile,  ’B:tstinpt2.Dat’ ) ; 
Assign(desiredf ile,  ’B:tstdes2.Dat’) ; 
Reset(inf ile) ; 

Reset(desiredf ile) ; 

End; 


(*****J)i  +  ******!t!*Jt;***»****J)t*********it:***********  +  *!(cj((  +  ***)tt*****}t<**) 


F-19 


Procedure  Open  output  files 


(*  Procedure  Open  output  files  *) 

(*  *) 
(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  None  *) 

Procedure  Open_output_f iles ; 

Begin 

Assign(errorf ile,  ’B:error.Dat’) ; 

Rewrite (errorfile) ; 

Assign(outf ile,  ’B:out.dat’ ) : 

Rewrite(outf ile) ; 

End; 


(*  Procedure  Close  input  files  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


Procedure  Close. input.f iles ; 
Begin 

Close(inf ile) ; 
Close(desiredf ile) ; 
End; 


(♦♦I)!***********************:********* +  **♦*****♦****♦♦**********) 


(*  Procedure  Close  output  files  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


Procedure  Close.output.f iles; 
Begin 

Close(errorf ile) ; 
Close(outf ile) ; 


End; 

( if  if  If  *  if  if  if  if  if  if  ifif  if  if  If  If  if  If  if  If  If  if  if  *  if  If  if  *  If  If  if  i|c  *  If  If  if  if  if  if  if  **  >(c  if  if  if*  if  if  *  If  if  if  t  He  If  f  if  If  if  If  if  ) 

(*  Procedure  Calc.numblocks  *) 

(*  *) 
(♦  This  procedure  calculates  the  number  of  blocks  to  *) 
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(* 

be  processed. 

*) 

(* 

*) 

(* 

Called  By: 

*) 

(* 

Main  Program 

*) 

(* 

Routines  Called:  None 

*) 

Procedure  Calc_nuinb?.ocks ; 
Begin 

Block_nuin:=datasize  div  N; 
End; 


(*  Procedure  Waltran  *) 
(*  *) 
(*  This  procedure  performs  the  forward  and  inverse  2N-point  *) 
(*  Fast  Walsh  Transform  (FWT) .  This  routine  calculates  *) 
(*  the  forward  and  inverse  transforms  using  the  same  loop:  *) 
(*  the  forward  transform  requires  the  loop  result  to  be  ♦) 
(*  multiplied  by  a  factor  of  1/(2N).  *) 
(*  The  algorithm  is  recursive  and  requires  P  stages,  where  *) 
(*  2N=2**P.  This  routine  requires  no  multiplications  *) 
(*  and  2NLog(2N)  summations,  where  the  logarithm  is  base  2.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Procedure  Past_Current_Block  *) 
(*  Procedure  Calculate_y  *) 
(*  Procedure  Calculate_error  *) 
(*  Procedure  Calculate_Gradient  *) 
(*  Procedure  Update_Weights  *) 
(*  Routines  Called:  *) 
(*  None  *) 
(*  Variables:  *) 
(*  P:  2N=2**P  *) 
(*  isign  :  indicates  inverse  or  forward  transform  *) 
(*  dataCj]  :  input  and  output  *) 
(*  F[P,l,j]  :Fast  Walsh  Matrix  result  *) 
(*  j=0,l,..2N-l  *) 


Procedure  Waltrein; 
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Var 

j , 1 , i , jmax , Imax , exponent : integer ; 
jlog, jinvrreal; 

Begin 

For  1:=1  to  (2*N)  Do 
Begin 

F[0,1,0] :=data[l-l] ; 

(*  WriteLnCLst,  ’  F(' ,0,1,0, ’ )=  ’,F[0,1,0]);  *) 

End; 

For  i:=0  to  P-1  Do 
Begin 

jlog:=(i+l)*Ln(2) ; 
jinv:=Exp(jlog) ; 
j  max : =Round ( j inv ) ; 

(*  WriteLnCLst,  ’jmax=  ’,  jmax);  *) 
lmax:=(2*N)  Div  jmax; 

(*  WriteLnCLst,  ’  kmax=  ’,  kmax) ;  *) 

For  1:=1  to  Imax  Do 
Begin 

For  j:=0  to  jmax-1  Do 
Begin 

exponent :=Cj+l)  Div  2; 

If  Odd C exponent)  then 
FCi+l,l,j] :=FCi, 2*1-1, Cj  Div  2)] 

-F[i,2*l,Cj  Div  2)] 

else 

F[i+l,l,j] :=FCi, 2*1-1, Cj  Div  2)] 

+FCi,2*l, Cj  Div  2)] ; 


End; 

End; 

End; 

For  j:=0  to  CC2*N)-1)  Do 
Begin 

if  isign=-l  then 
dataCj] :=F[P,1, j] 
else 

dataCj];=Cl/C2*N))*F[P,i,j]; 


End; 


End; 
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(* 

Procedure  Prepare. input_block_for_Waltran 

O 

(* 

*) 

(* 

This  routine  enters  the  data  values 

into  data[j]  in 

*) 

(* 

preparation  for  forward  or  inverse 

DWT. 

*) 

(* 

*) 

(* 

Called  By: 

*) 

(* 

Procedure  Past_Current_Block 

*) 

(* 

Procedure  Calculate.y 

*) 

(* 

Procedure  Calculate.error 

*) 

(* 

Procedure  Calculate.Gradient 

*) 

(* 

Procedure  Update.weights 

*) 

(* 

Routines  Called:  None 

*) 

(llotc********:***^;:*!:*:*****!*;***!^**#***********)*;***********:**************) 
Procedure  Prepare_input_block_for_Waltran; 

Var 

j  : integer; 

Begin 

if  isign  =1  then 

For  j:=0  to  (2*N)-1  Do 
begin 

data[j] :=input_block[j] ; 
end; 

if  isign  =-l  then 

For  j:=0  to  (2*N)-1  Do 
begin 

data[j]  :=V2[j]  ; 
end; 


End; 


(*  Procedure  Past_Current_Block  *) 
(*  *) 
(*  This  routine  concatenates  the  current  and  previous  blocks  *) 
(*  together:  [(previous) (current)] .  Each  block  is  N  points  *) 
(*  long;  the  combination  is  2*N  points  long.  *) 
(*  *) 
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(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_Waltran  *) 
(*  Procedure  Waltran  *) 
(*  Variables:  *) 
(*  input_block[j]  :  (previous  blck, current  blck)  *) 


(*Jicj|tj(i!(t*****!(;***!(!***!(!***  +  :*!<<***i(c**)|t*!(c***i|c**;(tj|tj(c*!t:*:(c***)(:***i(cH‘^:*******  +  *) 
(j(cj(c)t;>(c**!t;******  +  ******jt!!)c!(!!t::)!******j|c*j|c*#*it:***j|c)(c*****j(:it:**!(!  +  >(!^c***j(cj(c*!t:*)(c*) 

Procedure  Past_Current_Block; 

Var 

j : integer; 

Begin 


isign:=l; 

For  j:=0  to  (2*N)-1  Do 
Begin 

if  (k*N-N+j<0)  then 
input_block[j] :=0 
else 

innut  block PiT :=innutri+k*N- 


End; 

Prepare. input _block_f or .Waltran; 
Waltran; 


End; 

(*!t:#l)c**:t:*;(!  +  **:(c)(c*******!(c**#*******!(i*4:********!|c*******  +  *!(c**>|ci(c*i)e  +  ;tt**) 


(*  Procedure  Load.input  *) 
(*  *) 
(*  This  procedure  reads  in  the  input  sequence  from  a  data  *) 
(*  file.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


(♦))c>(cj(c***)t:**J(tKi*:(c***********Kt*J(t*******J|c****:tc**;f;(c**i(!***>)tjtc!(ci(c}(c*)|<***>(c3(c+) 

Procedure  Load.input; 

Var 


j  '.integer; 


Begin 


For  j:=0  to  datasize-1  Do 
ReadLnCinfile, input [j]) ; 


End; 


(♦**  +  ****  +  **  **J)c***i|c**l(t*****  +  *******************  ******************) 


(*  Procedure  Load_desired  *) 
(*  *) 
(*  This  procedure  reads  in  the  desired  sequence  from  a  data  *) 
(*  file.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


(**)*:*%**♦****%♦*♦*********  *Jt;***J(!  +  lt;****l(c*  +  *l(t*>(c****»i(:>(c**!4:*t********) 

Procedure  Load.desired; 

Var 

j : integer: 

Begin 

For  j:=0  to  datasize-1  Do 

RsadLn(desiredfile, desired [j] ) ; 


End; 


(*  Procedure  Write.output  *) 
(*  *) 
(*  This  procedure  writes  the  filter  output  and  error  *) 
(*  vectors  to  data  files.  *) 
(*  *) 
(♦  Called  By:  ♦) 
(*  Main  Program  *) 
(*  Routines  Called: None  *) 


Procedure  Write_output; 
Var 
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j : integer; 


Begin 

For  j :=0  to  datasize-1  Do 
Begin 

WriteLn(outf ile,y  [j] ) ; 

WriteLn(errorf ile, error Cj] ) ; 

End; 

End; 

(l(tl(t*********>t!*  +  **  +  **********>!'*li<!t!*lt:******!(t**!t:>it**Jt:**)(:*J(t**J(cX:>|!**j([*!i() 

Procedure  ClockOn; 

Begin 

GetTimeChr ,m,s ,slOO) ; 

StartClock : = (hr*3600) + (m*60) +s+ (s 100/ 100) ; 

End; 

(*********>tt****»****!)"**!(c***************>(t****)tc**!(c!(cj(t>t:*:(c*)(<3(;******!t:*) 

Procedure  ClockOff; 

Begin 

GetTime(hr,m,s,slOO) ; 

StopClock :  =  (hr*3600)+(in*60)+s+  (slOO/lOO)  ; 

WriteLn( ’Elapsed  time  =  ’ , (StopClock-StartClock) :0:2) ; 

End; 

(t********t******’^*********^f>t<*****t*********if  *******************) 

(.*  Procedure  Diagonal_of_X  *) 

(*  *) 

(♦  This  procedure  creates  the  data  vector  X.  *) 

(*  The  X  data  vector  represents  the  diagonal  component  *) 

(*  of  a  diagonal  matrix  that  contains  the  DWT  of  the  *) 

(*  concatenated  previous  and  current  input  blocks.  *) 

(*  *) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  None  *) 

(*  Variables:  *) 

(*  XCj]  :  diagonal  values  *) 

(*  *) 

It:  *******************})(  If) 

Procedure  Diagonal_of_X; 

Var 

j : integer; 
power : real; 


Begin 


For  j:=0  to  (2*N)-1  Do 
begin 

X[j]  :=dataCj]  : 

(*  WriteLnCLst,  ’  XC’,j,  ’]  =  ’,XCj]);  *) 
end; 


end; 

(♦Jt!***!*!****!*!*!!!**************************:*:************************) 

Procedure  Calculate_avg_input_bin_pwr; 

Var 

num, j : integer; 

Begin 

num : =Block_num- 1 ; 

For  k:=l  to  Block_nuin-l  Do 
Begin 

Past_current_block ; 

For  j:=0  to  (2*N)-1  Do 
Begin 

Pbin[j]  :=PbinCj]+Sqr(data[j] ) ; 

End; 

End; 

For  j:=0  to  (2*N)-1  Do 
Begin 

Pbin[j] :=(l/num)*Pbin[j] ; 

(*  WriteLnCLst,  ’  PbinC’,  j,  ’)  =’,Pbin[j]);  *) 

End; 

End; 

^:lcilc^i^i!l>4:****Jt-*******************************i‘**t***********i‘**) 

(:(C*!tt**j(l*!(C!t!********  *♦***♦♦ 

Procedure  Calculate_mu ; 

Var 

j : integer; 
avgPwrrreal ; 

Begin 

avgPwr : =0 ; 

For  j:=0  to  (2*N)-1  Do 
Begin 

avgPwr : =avgPwr+Pbin [j] * (1/ (2»N) ) ; 

(*  gain_mu[j] :=  Misadjust/(Pbin[j]+l .OE-8) ;  *) 
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End; 

(*  gain_mu[6]  :=gain_inu[7] ;  *) 

mu:=Hisadjust/avgPwr ; 

WriteLndst,  ’  gain  constant  mu  =  ’ ,  mu); 

(*  WriteLndst,  ’  average  power  =  avgPwr) ;  *) 

End; 

(**************!|'*******  +  **************lt!l|t******************J|<**!(t*>(c) 
(*********************************************♦*****+***********) 


(*  Procedure  Perform_Matrix_Multiply  *) 
(*  *) 
(*  Multiplies  a  2Nx2N  matrix  by  a  2Nxl  dimension  vector.  *) 
(.*  The  matrix  in  all  cases  is  a  diagonal  matrix  so  the  *) 
(*  routine  automatically  ignores  the  off  diagonal  terms  *) 
(*  during  the  multiplication.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Procedure  Calculate_y  *) 
(*  Procedure  Calculate.Gradient  *) 
(*  Routines  Called:  None  ♦) 
(*  Variables:  *) 
(*  V2[j]  :  the  resulting  2Nxl  vector  *) 
(*  *) 


Procedure  Perform_Matrix_Multiply(var  M,V:  RealArrayN2) ; 


Var 

j : integer ; 

Begin 

For  j:=0  to  (2i'K)-l  Do 
Begin 

V2Cj]:=HCj]*VCj]: 

End; 

End; 

(^^^i:i^****i^:*:fit***************************************************') 


(*  Procedure  Calculate.y  *) 
(*  *) 
(♦  This  procedure  calculates  the  output  sequence  values  *) 
(*  for  the  current  block  being  processed.  The  output  is  ♦) 
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(*  equal  to  the  last  N  terms  of  the  inverse  DWT  of  the  *) 
(*  product  of  X  and  the  walsh  domain  weight  vector.  *) 
(*  *) 
(*•  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Waltran  *) 
(*  Procedure  Prepare. input _block_for_Waltran  *) 
(*  Procedure  Perform_Matrix_Multiply  *) 
(*  Variables:  *) 
(*  yCj]  :  filter  output  *) 
(*  *) 


Procedure  Calculate.y; 

Var 

j : integer; 

Begin 

Perform_Matrix_Multiply(X,H) ; 
isign:=-l: 

Prepare. input_block_for_Waltran; 

Waltran: 

For  j :=0  to  N-1  Do 
Begin 

y[k*N+j] :=dataCN+j] ; 

(*  WriteLnCLst,  ’  y( ’ ,k*N+j , ’)=  ’,y[k*N+j]);  *) 

End; 


End; 

(********♦****♦***♦*♦♦**  *J(i:(i***********************  *♦♦♦*♦*♦***♦*♦) 


(*  Procedure  Calculate.error  *) 
(*  *) 
(*  This  procedure  calculates  the  error  sequence  values  for  *) 
(*  the  current  block  and  the  complex  error  vector.  *) 
(*  The  error  block  for  the  current  input  *) 
(*  block  equals  the  current  desired  block  minus  the  output  *) 
(*  for  the  current  input  block.  The  error  vector  *) 
(*  ERRCj] ,  equals  the  FFT  of  the  zero  padded  error  block:  *) 
(*  DWT[N  zeros,  error  block].  *) 
(*  *) 
(*  Called  By:  *) 
(♦  Main  Program  *) 


(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_Waltran  *) 
(*  Procedure  Waltran  *) 
(*  Variables:  *) 
(*  ERR[j]  :  the  DWT  of  the  error  sequence  *) 
(*  for  the  current  block  *) 
(*  *) 


(it********************************  *♦**♦******!(:**♦*  **********♦***) 

Procedure  Calculate_error ; 

Var 

j : integer; 
e:RealArrayN2: 

Begin 

For  j :=0  to  N-1  Do 
begin 

e[j] :=0; 

input_block[j] :=e[j] ; 

end; 

For  j:=N  to  (2*N)-1  Do 
Begin 

e[j]  :=desiredCk>t‘N+j-N]-y[k*N+j-N]  ; 
input_block[j] :=e[j] ; 
error Ck*N+j-N] :=e[j] ; 

(*  WriteLndst,  ’  e(’ ,k*N+j-N,’)  =  ’ ,  error Ck*N+j -N] )  ;  *) 

End; 

isign:=l; 

Prepare_input_block_f or_Waltran ; 

Waltran; 

For  j:=0  to  (2*N)-1  Do 
begin 

ERR[j] :=data[j] ; 
end; 

End; 


(*  Procedure  Calculate.Gradient  *) 
(*  *) 
(*  This  procedure  calculates  the  gradient  sequence  for  the  *) 
(*  current  block  being  processed.  The  gradient  sequence  *) 
(*  equals  the  first  N  terms  of  the  inverse  DWTT  of  the  *) 
(*  product  of  X  and  the  error  vector  E.  ♦) 
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(*  *) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called:  *) 

(*  Procedure  Perfonn_Hatrix_Multiply  *) 

(*  Procedure  Prepare_input_block_for_Waltran  ♦) 

(*  Procedure  Waltran  *) 

(*  Variables:  *) 

(*  gradCj]:  gradient  sequence  for  current  block  *) 

(*  ♦) 


(******************♦**♦♦**♦*♦********♦*♦**♦**♦****»♦♦*♦*♦*♦*♦*) 
Procedure  Calculate.Gradient; 

Var 

j : integer; 

Tgrad : Real ArrayH2 ; 

Begin 

Perform_Hatrix_Multiply(X,ERR) ; 

For  j:=0  to  (2*N)-1  Do 
Begin 

gradCj]  :=V2[j]  ; 

(*  WriteLndst,  ’  Grad(’,  j,  ’)=  grad[j]);  *) 

End; 

(♦  isign:=-l;  ♦) 

(*  Prepare_input_block_for_Waltran;  ♦) 

(*  Kaltran;  *) 

(♦  For  j:=0  to  (2*N)-1  Do  *)  (*  Calculate  the  time 

(*  Begin  ♦)  (♦  domain  gradient  ♦) 

(*  Tgrad[j] :=data[j3 ;  ♦) 

(♦  WriteLndst,  ’  grad(’,j,’)=  Tgrad  [j]);  *) 

(*  End;  ♦) 

End; 


(***^itc**m*  *********  ***************m*****i^**********»******  ******) 


(*  Procedure  Update.weights  *) 
(*  ♦) 
(*  This  procedure  updates  the  filters  tap  weights.  The  *) 
(*  new  weights  equal  the  old  weights  plus  the  product  of  the  *) 
(*  gain  constant  and  the  gradient  vector.  The  •) 
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(*  gradient  vector  equals  the  DWT  of  the  gradient  ♦) 
(*  sequence  padded  with  N  zeros:  DWT[(grad  seq) ,  K  zeros].  *) 
(*  *) 
(♦  Called  By:  *) 
(♦  Main  Prograa  ♦) 
(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_Waltran  ♦) 
(*  Procedure  Waltran  ♦) 
(♦  Variables:  •) 
(♦  H[j]  :  Walsh  donain  weight  vector  *) 


(******:***4i****#*#«*****««*******«******»*«**«************#****«) 

Procedure  Update_weights: 

Var 

tap.j : integer: 

Begin 

For  tap:=0  to  (2*f0-l  Do 
begin 

HCtap] :=HCtap3+su»grad[tap] ; 

(*  WriteLn(Lst,  ’  H(’,  tap,  ’)=  HCtap]);  ♦) 

end; 


End; 

(«»**#****•*•****••••••••*•*«•••*•*»*•*••••***»*•»***•*•••••••• ) 

(♦  Procedure  tine_doraain_wts  ») 

(*********««**«««:•*«••**«««**•«••*•*••••••••*•»••*•***•*»•••••*) 

Procedure  tine_donain_wts; 

Var 

j: integer; 

Begin 

For  j:=0  to  (2*K)-1  Do 
Begin 

V2[j]:=HCj]: 

(•  WriteLn(Lst,  K[j3):  •) 

End; 

isign:=-l ; 

Prepare_ input_block_f or_Waltran ; 

Waltran: 

(•  WriteLn(Lst,  '  Block  k);  •) 

For  j:=0  to  (2*!t)“l  Do 
Begin 


w[j]  :=data[j]  ; 


End; 

End; 

(*  Procedure  Set_weights  *) 

(«**>)(*  It:**  4:  >|c’I<****!<<*****:4<4:*i|<***  *)«:**) 

Procedure  Set.weights; 

Var 

j : integer; 

Begin 

W[0] : =48. 4796; 

W[l] : =5. 6844; 

W[2] : =5. 0732; 

W[3] : =10. 7032; 

For  j:=0  to  (2*N)-1  Do 
input_block[j] :=WCj] ; 
isign:=l; 

Prepare. input_block_for_Waltran; 

Waltran; 

For  j:=0  to  (2*N)-1  Do 
HCj]  :=data[j]  ; 

End; 

(*************************************************  *****1^***!^***^^:^^ 
(************************  Main  Progreim  *************************) 
(*****************************************************************) 

Begin 

Open.input.f iles ; 

Open.output.f iles; 

Init.var ; 

Load. input; 

Load.desired; 

Calc.numblocks ; 

Calculate. avg.input.bin.pwr; 

Calculate.mu; 

(*  Set.weights;  *) 

(*  ClockOn;  *)  (*  Turn  Clock  on  *) 

For  k;=0  to  Block. num-l  Do 
Begin 

(*  WriteLnC  ’  processing  block’,  k) ;  *) 


Past_current_block ; 

Diagonal.of _X; 

Calculate_y ; 

Ca3  culate_error ; 

Calculate_gradient ; 

Update_weights ; 

(*  time_domain_wts ;  *) 

end; 

(*  ClockOff;  *)  (^Display  elapsed  time*) 

(*  WriteLn;  *) 

(*  WriteC’Press  Enter..  ’);*) 

(*  ReadLn;  *) 

(*  time_domain_wts;  *) 

Write_output; 

Close_input_f iles ; 

Close_output_f iles; 

End. 
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F.3  FDF  Filter  Listing 


This  is  the  Turbo  Pascal  6.0  listing  of  the  FDF  program. 


Program  Freq_adfil: 

{$N+} 

Uses  Printer , CRT, DOS; 

CONST 

N=16;  (***  N  is  block  size*) 

datasize=992: 

Misadjust=0. 1 ; 

TYPE 

RealArrayN4=AP.RAY[l .  .4*N]  of  real; 

RealArrayN2=ARRAY[l. .2*N]  of  real; 

InputArray=ARRAY[l . .datasize]  of  real; 

OutputArray=ARRAY[l . .datasize]  of  real; 

VAR 

hrr,m,s ,slOO:Word; 

StopClock , StartClock : Real ; 
data ; RealArrayN4 ; 

XR,XI,XI.conj,HR,ER,WR,WI,EI,HI,V2R,V2I,input_block,grad:RealArrayN2; 

igain.mu , rgain.mu , Pbinr , Pbini : RealArrayN2 ; 

desired, input :Inj  .tArray; 

error , y : Output Array ; 

isign,nn,Block_num,k: integer ; 

mu: real ; 

inf ile,desiredfile, errorfile,outf ile: text ; 

weigh to, weight 1 , weight2, weights, weight4, weights, weights, weight?: text; 

******!)<*********************«*  ********) 


(*  Procedure  Init_var  *) 
(*  *) 
(*  This  procedure  initializes  all  variables.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


(♦♦♦♦♦♦♦****j(c**  +  **i4i*********j(!******j(c*j|tj(c*  +  %it:*****'4:*^c*****!|!******) 

Procedure  Init.var; 

Var 

j : integer; 


Begin 


Block_num:=0; 

For  j:=l  to  datasize  Do 
Begin 

error Cj] :=0; 
desired[j]  :=0; 
input [j] :=0; 

y[j]  :=0; 

End; 

For  j :=1  to  2*N  Do 
Begin 
XRCj]:=0; 

XI[j]:=0; 
XI_conj[j] :=0; 
HRCj]:=0; 

HI[j]:=0; 

ERCj]:=0; 

EI[j];=0: 
V2R[j]:=0; 
V2I[j]:=0; 
input_block[j] :=0; 
gradCj] :=0; 
igain_au[j] :=0; 
rgain.muCj] :=0; 
PbinrEj] :=0; 
PbiniCj] :=0; 

End; 


End; 

Procedure  Open_input_f iles ; 

Begin 

AssignCinfile,  ’A:S53N.Dat’) ; 

Assign(desiredfile,  ’A:S5.Dat’); 

Reset(inf ile) ; 

Reset (desiredfile) ; 

End; 

(^*:^^c*:^*t*>>:***ll^*^**tilf**^f**’^ilf’^i>i*:¥**^:**ii:*A‘*^f**’^*****ylf**>lf  ********") 

Procedure  Open_output_files ; 

Begin 

AssignCerrorfile,  ’B:FFS3SNE.Dat’) ; 

Rewrite(errorfile) ; 

AssignCoutf ile,  ’B:FFS4SNY.Dat’) ; 
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RewriteCoutf ile) ; 


End; 

(  +  *  +  ***  Jt: ******♦!(!*♦  *********** 3(C!(C  ******  Jj:  *♦>(;** !f:  )(:*  J(r  J(c **!(:  4;  4;  )(;  J(:  ) 

Procedure  Close_input_f iles; 

Begin 

CloseCinf ile) ; 

Close (desiredf ile) ; 

End; 

(**************************************************************^ 
Procedure  Close_output_f iles ; 

Begin 

Close (errorf ile) ; 

Close(outfile) ; 


End; 

(************************************************************** ^ 


(* 

(* 

(* 

(* 

(* 

(* 

(* 

(* 


Procedure  Calc.numblocks 

This  procedure  calculates  the  number  of  blocks  to 
be  processed. 

Called  By: 

Main  Program 
Routines  Called:  None 


*) 

*) 

*) 

*) 

*) 

*) 

*) 

*) 


(**************************************************************^ 


Procedure  Calc_numblocks ; 
Begin 

Block_num:=datasize  div  N; 


End; 


(**************************************************************:^:4,^,|,^ 


(*  Procedure  FFT  *) 
(*  ♦) 
(*  This  procedure  calculates  the  forward  and  inverse  Fast  ♦) 
(*  Fourier  Transform  of  a  data  sequence  that  has  a  power  of  ♦) 
(*  2  number  of  data  points.  Both  real  and  complex  data  can  *) 
(*  be  transformed.  The  routine  has  two  sections.  The  first  *) 
(*  section  sorts  the  input  data  into  bit-reversed  order.  The  *) 
(*  second  section  has  an  outer  loop  that  is  executed  log  N  ♦) 
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(*  (power  2)  times.  Transforms  of  length  2,4.8 . N  are  *) 

(*  calculated  in  this  section.  The  section  has  two  nested  *) 

(*  inner  loops  that  execute  the  Danielson-Lanczos  Lemma.  *) 

(*  Data  tranformed  or  inverse  transformed  is  entered  into  *) 

(*  the  vector  data[j]  according  to  R1 ,11 ,R2,I2 , . . .RN ,IN ;  *) 

(*  where  R1  and  II  represent  the  real  and  imaginary  *) 

(*  components  of  the  first  data  value  or  transform  value.  *) 

(*  Transform  results  are  returned  in  dataCj]  in  the  Scune  fashion.*) 
(*  The  forward  and  inverse  transforms  are  indicated  to  the  *) 

(*  routine  by  setting  the  isign  flag:  isign=l  indicates  *) 

(*  forward  transform,  isign=-l  indicates  inverse  transform.  *) 

(*  In  the  case  of  inverse  transform  the  resultant  *) 

(*  is  scaled  by  a  factor  equal  to  the  number  of  points  *) 

(*  transformed.  *) 

(*  *) 
(*  Called  By:  *) 

(*  Procedure  Past_Current_Block  *) 

(*  Procedure  Calculate.y  *) 

(*  Procedure  Calculate.error  *) 

(*  Procedure  Calculate.Gradient  *) 

(*  Procedure  Update.weights  *) 

(*  Routines  Called:  None  *) 

(*  Variables:  *) 

(*  isign:  indicates  inverse  or  forward  transform  *) 

(*  data[j]:  input  and  output  *) 

(*  nn:  number  of  points  to  be  transformed  *) 

(*  n  :  number  of  Re  and  Im  value  in  dataCj]  =2*nn  *) 

Procedure  FFT ; 

VAR 

ii, j j ,n,mmax,m, j ,istep,i: integer; 
wtemp , wr , wpr , wp i , w i , theta : double ; 
tempr , tempi ,wrs ,wis :real ; 

Begin 

n:=64;  (*  2  times  2N  *) 

nn:=32;  (*  2N  *) 


For  ii:=l  To  nn  Do  Begin 

i:=2*ii-l; 

If  j>i  Then  Begin 
tempr :=data[j3 ; 


tempi :=dataCj+l] ; 
dataCj] :=data[i] ; 
dataCj+l] :=dataCi+l3 ; 
dataCi] :=tempr; 
dataCi+1] :=tempi; 

End; 

m:=n  DIV  2; 

While  (m  >=  2)  And  (j  >  m)  Do  Begin 
ra:=m  DIV  2 

End; 

j:=j+m; 

End; 

inmax:=2; 

While  n  >  mmax  Do  Begin 
istep:=2*mraax; 

theta : =6 . 283185307 17959/ (isign*mmax) ; 
wpr:=-2.0*sqr(sin(0.5*theta)) ; 
wpi:=sin(theta) ; 

Mr:=1.0; 

wi:=0.0; 

For  ii:=l  To  mmax  DIV  2  Do  Begin 

m:=2*ii-l ; 
wrs : =wr ; 
wis  :=wi ; 

For  jj:=0  To  (n-m)  DIV  istep  Do  Begin 

i:=m+j j*istep; 
j :=i+mmax ; 

tempr : =wrs*data [j] -wis*data [ j+l] ; 
tempi :=wrs*dataCj+l]+wis*data[j] ; 
dataCj] :=data[i] -tempr; 
data[j+l] :=dataCi+l] -tempi; 
data[i] :=data[i]+tempr; 
dataCi+l] :=data[i+l]+tempi 

End; 

wtemp:=wr ; 

wr : =wr*wpr-wi*Mpi+Hr ; 
wi : =wi*wpr+Htemp*wpi+wi ; 
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End; 


mmax:=istep; 

End; 

End; 


(********>(:  Jit*^)|c*l(::t:***:(c!)t*!(c*)|c***>t!**!(!*)(:*Jt:***!(t*!4c*:(c!(c**it:)t:**!(c**************) 


(*  Procedure  Prepare. input _block_for_FFT  *) 
(*  *) 
(*  This  routine  enters  the  data  values  into  data[j]  in  *) 
(*  preparation  for  forward  or  inverse  FFT.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Procedure  Past_Current_Block  *) 
(*  Procedure  Calculate.y  *) 
(*  Procedure  Calculate.error  *) 
(*  Procedure  Calculate.Gradient  *) 
(*  Procedure  Update.weights  *) 
(*  Routines  Called:  None  *) 


(^:tf^>tiit(:^^^fitHfiif^i^^^t********************************t***At^t}lfilf)lf}tc*>t!********) 

Procedure  Prepare_input_block_for_FFT ; 

Var 

j : integer; 

Begin 

if  isign  =1  then 

For  j :=1  to  2*N  Do 
begin 

data[2=t'j-l]  :=input_block[j]  ; 
data[2+j] :=0; 
end; 

if  isign  =-l  then 

For  j :=1  to  2*N  Do 
begin 

dataC2*j-l] :=V2R[j] ; 
dataC2*j] :=V2I[jT ; 
end; 
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End; 


(***J|<!(s***********>lt**>(t!t!********>t:!(<!|t*>|t*!(!*Jt:****!(:*>H**********  +  Jt:****!(o|c:((**) 


(*  Procedure  Past_Current_Block  *) 
(*  *) 
(*  This  routine  concatenates  the  current  and  previous  blocks  *) 
(*  together:  [(previous) (current)] .  Each  block  is  N  points  *) 
(*  long;  the  combination  is  2*N  points  long.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(.*  Procedure  Prepare_input_block_f or_FFT  *) 
(*  Procedure  FFT  *) 
(*  Variables:  *) 
(*  input_block[j]  :  (previous  blck, current  blck)  *) 


(********************************♦}♦!******♦*******#**!(!********♦*****) 


Procedure  Past_Current_Block; 

Var 

j : integer; 

Begin 

isign:-l; 

For  j  :=1  to  2’^N  Do 
if  (k*N-N+j"l<0;  then 
input_block[j] :=0 
else 

input_block[j] :"input[j+k*N-N] : 
Prepare_input_block_for_FFT ; 

FFT; 


End ; 


(*  Procedure  Load_input  *) 
(*  ♦) 
(*  This  procedure  reads  in  the  input  sequence  from  a  .iata  ♦) 
(*  file.  ♦) 
(*  *) 
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(*  Called  By:  *) 
(*  Main  Program  *) 
(+  Routines  Called:  None  *) 


Procedure  Load. input; 

Var 

j : integer; 

Begin 

For  j:=l  to  datasize  Do 
ReadLn(infile, input  [j]) ; 

End; 


(*****!!'******>Kil'**')'****>t:*******J(c****!(c*lt!***!|t*#***  ******  **♦**♦♦***♦*) 


(*  Procedure  Load.desired  ♦) 
(*  *) 
(*  This  procedure  reads  in  the  desired  sequence  from  a  data  *) 
(*  file.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 


(********************************************S*****************i)c*) 


Procedure  Load.desired; 

Var 

j : integer; 

Begin 

For  j:=l  to  datasize  Do 

ReadLn(desiredfile,desired[j] ) ; 


End; 

(***********************************************************) 
(*  Procedure  Write.output  *) 


(*  *) 

(*  This  procedure  writes  the  filter  output  and  error  *) 

(*  vectors  to  data  files.  *) 

(*  *) 

(*  Called  By:  *) 

(*  Main  Program  *) 

(*  Routines  Called: None  *) 


Procedure  Write_output; 

Var 

j : integer; 

Begin 

For  j:=l  to  datasize  Do 
Begin 

WriteLnCoutf ile,y[j3 ) ; 
WriteLn(errorfile,errorCj] ) ; 

End; 

End; 

*******  **:^‘**^:**^***^l****^li‘**^|l****:^‘****  ******  ******) 

Procedure  ClockOn; 

Begin 

GetTime (hrr ,m , s , s 100) ; 

StartClock : = (hrr*3600) + (m*60) +s+ (slOO/100) ; 

End; 

^**:t!**i:*^:it:****************t*  ******************************  ******) 

Procedure  ClockOff; 

Begin 

GetTime(hrr,m,s,slOO) ; 

StopClock:=(hrr*3600)+(m*60)+s+(sl00/ 100) ; 

WriteLnC ’Elapsed  time  =  ’ , (StopClock-StartClock) :0:2) ; 

End; 

^***************************************************************) 


(*  Procedure  Diagonal_of_X  *) 
(♦  ♦) 
(*  This  procedure  creates  two  data  vectors:  XR  and  XI.  *) 
(*  The  two  data  vectors  represent  the  diagonal  component  *) 
(*  of  a  diagonal  matrix  that  contains  the  FFT  of  the  *) 
(*  concatenated  previous  and  current  input  blocks.  XR  ♦) 
(*  represents  the  real  part  of  each  value  and  XI  represents  *) 
(*  the  corresponding  imaginary  part: (diagonal  of  X)=XR+XI.  *) 
(*  *) 


(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  None  *) 
(*  Variables:  *) 
(*  XR[j]  :  diagonal  real  values  *) 
(*  XI [j]  :  diagonal  imaginary  values  *) 
(*  *) 


(!(t)t:***Jtcitt*****!(c  +  )|c*#  +  **Jic****:|c!t:**!|c******J(!Jic*****:*!J|c**********>t=*******) 


Procedure  Diagonal.of.X; 

Var 

j : integer; 
power: real ; 

Begin 

For  j :=1  to  2*N  Do 
begin 

XRCj]  :=data[2*j-l]  ; 

XI Cj] :=data[2*j] ; 

HriteLnCLst,  '  X(’,j-1,0=  ’  ,XRCj]  , '+i’ ,XI  [j] ) ; 
end; 


end; 

(_****t*****************t***************:’H‘**********************) 

Procedure  Calculate_avg_input_bin_pwr ; 

Var 

num, j : integer; 

Begin 

num : =Block_num- 1 ; 

For  k:=l  to  Block_num-l  Do 
Begin 

Past_current_block ; 

For  j :=1  to  2*N  Do 
Begin 

PbinrCj] :=PbinrCj]+Sqr(data[2*j-l]) ; 

PbiniCj] :=Pbini [j] +Sqr(data[2*j]  ) ; 

End; 

End; 

For  j:=l  to  2*N  Do 
Begin 

PbinrCj] :  =  (l/nura)*PbinrCj]  ; 

PbiniCj] :=(l/num)*PbiniCj] ; 


End; 


End; 

(^^:7t:*ilH::^****^iilli^:iHi^i^iiiLjHf:ii*^i^i*t***********************************) 

Procedure  Calculate_mu; 

Var 

j : integer; 

avgPwr , ravgPwr , iavgPwr : Real ; 

Begin 

avgPwr : =0 . 0 ; 
ravgPwr : =0 ; 
iavgPwr :=0; 

For  j :=1  to  2*N  Do 
Begin 

ravgPwr :=ravgPwr+Pbinr[j] ; 
iavgPwr :=iavgPwr+Pbini[j] ; 

(*  rgain_muCj] :=Kisadjust/(Pbinr[j]+1.0E-8) ;  *) 

(*  igain_mu[j] :=Misadjust/(Pbini[j]+1.0E-8) ;  ♦) 

(*  WriteLn(Lst,  ’  rmuC’.j,’)  =’,  rgain_mu[j] ) ;  *) 

(*  WriteLnCLst,  ’  imu(’,j,’)  igain_mu[j] ) ;  ♦) 

End; 

avgPwr : = (ravgPwr+iavgPwr) ♦ ( 1/ (4*N) ) ; 

WriteLnCLst,  ’  avgPwr  =  avgPwr); 
mu : =Hisadjust/avgPwr ; 

WriteLnCLst,  ’  gain  constant  mu  =  ’ ,  mu); 

End; 


(**,t:^:il!m********************************************************) 


(*  Procedure  Conjugate.X  ♦) 
C*  ♦) 
C*  This  procedure  creates  the  conjugate  of  the  diagonal  ♦) 
C*  matrix  X.  The  routine  creates  the  conjugate  of  X  ♦) 
C*  by  creating  XI_conj[j]  which  is  the  negative  of  XI [j].  *) 
C*  Then,  the  conjugate  of  the  diagonal  of  X  equals  ♦) 
C*  XR+XI_conj.  *) 
C*  ♦) 
C*  Called  By:  ♦) 
C*  Main  Program  •) 
C*  Routines  Called:  None  *) 
C*  Variables:  *) 
C*  XI_conj[j]  :  -XI  [j]  ») 
C*  *) 


(*****************************************»********************) 
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Procedure  Conjugate_X; 

Var 

j ; integer; 

Begin 

For  j :=1  to  2*H  Do 
Xl.conj  Cj] :=-XlCj] ; 

End; 

xm*********************************************************) 


(♦  Procedure  Perfonn_Matrix_Kultiply  ♦) 
(♦  ♦) 
(♦  Multiplies  a  2Nx2U  matrix  by  a  2F{xl  dimension  vector.  ♦) 
(*  The  matrix  in  all  cases  is  a  diagonal  matrix  so  the  *) 
(*  routine  automatically  ignores  the  off  diagonal  terns  ») 
(*  during  the  multiplication.  ♦) 
(*  ») 
(»  Called  By:  ♦) 
(*  Procedure  Calculate_y  ») 
(*  Procedure  Calculate.Gradient  *) 
(*  Routines  Called:  Hone  ♦) 
(*  Variables:  •) 
(*  V2I[j]  :  the  resulting  vector  imaginary  component  ♦) 
(*  V2RCj3  :  the  resulting  vector  real  component  ») 
(*  •) 


(m**m******m***»************************************************) 

Procedure  Perfom_Matrix_Kultiply(var  MR, MI, VR, VI:  ReaiArrayH2) ; 


Var 

j: integer; 

dRl ,dR2,dIi ,dI2:double, 
RRi.RR2.RII,RI2:real; 

Begin 

For  j:=l  to  2»K  Do 
begin 

dRl:=MR[j]*VRCj]; 

dR2:=-(MI[j3*VlCj]); 

RRl:=dRl: 


RR2;=dR2: 

V2R[j] :=RR1+RR2; 
dIl:=MRCj]*VI  [j] : 
dT2:=MI[j]*VR[j] ; 
Rll;=dll; 
RI2:=dI2; 

V2I[j] :=RI1+RI2; 
end; 


End; 


(*  Procedure  Calculate.y  *) 
(*  *) 
(*  This  procedure  calculates  the  output  sequence  values  *) 
(*  for  the  current  block  being  processed.  The  output  is  *) 
(*  equal  to  the  last  N  terms  of  the  inverse  FFT  of  the  *) 
(*  product  of  X  and  the  complex  weight  vector.  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  FFT  *) 
(*  Procedure  Prepare_input_block_for_FFT  *) 
(*  Procedure  Perform_Matrix_Multiply  *) 
(*  Variables:  *) 
(*  y[j]  :  filter  output  *) 
(*  *) 


Procedure  Calculate.y; 

Var 

j : integer; 

Begin 

Perform_Matrix_Hultiply(XR,XI ,HR,HI) ; 
isign:=-l; 

Prepare_input_block_for_FFT ; 

FFT; 

For  j :=1  to  N  Do 

y[k*N+j] :=(l/(2*N))*dataC2*(N+j)-l] ; 
End; 
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(******)t:***J(t***!|<************3(<*:t:*!(c*****!(t !(:***>(  ******!(:*******>(<***!(<*) 


(*  Procedure  Calculate_error  *) 
(*  *) 
(*  This  procedure  calculates  the  error  sequence  values  for  *) 
(*  the  current  block  and  the  complex  error  vector.  v) 
(*  The  error  block  for  the  current  input  *) 
(*  block  equals  the  current  desired  block  minus  the  output  *) 
(*  for  the  current  input  block.  The  complex  error  vector  *) 
(*  E[j].  equals  the  FFT  of  the  zero  padded  error  block:  *) 
(*  FFT[N  zeros,  error  block].  *) 
(=1  ♦) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_FFT  *) 
(*  Procedure  FFT  *) 
(*  Variables:  *) 
(*  ER[j]  :  real  part  of  the  FFT  of  the  error  sequence  *) 
(*  for  the  current  block  ♦) 
(*  EI[j]  :  imaginary  part  of  the  FFT  of  the  error  seq  *) 
(*  for  the  current  block  *) 
(*  *) 


Procedure  Calculate_error; 

Var 

j : integer; 
e:RealArrayN2; 

Begin 

For  j :=1  to  N  Do 
begin 

e[j] :=0: 

input_block[j] :=e[j] ; 

end; 

For  j :=N+1  to  2*N  Do 
Begin 

e[j]  :=desired[k*N+j-N] -y [k>i<N+j-N]  ; 
input_block[j] :=e[j] ; 
error  [k*N+j-N3 :=e[j] ; 

End; 

isign:=l; 

Prepare_input_block_for_FFT; 
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FFT; 

For  j :=1  to  2*N  Do 
begin 

ERCj] :=data[2*j-l] ; 
El [j] :=data[2*j] ; 
end; 


End; 

(****Jt:j(c!(c*Jt:*)|t**J(c*J("  +  ****  **!(!*******!(:***  *********************!*:****) 


(* 

Procedure  Calculate.Gradient 

*) 

(* 

*) 

(*  * 

This  procedure  calculates  the  gradient  sequence  for  the 

*) 

(* 

current  block  being  processed.  The  gradient 

sequence 

*) 

(* 

equals  the  first  N  terras  of  the  inverse  FFT 

of  the 

*) 

(* 

product  of  X  conjugate  and  the  error  vector 

E. 

*) 

(* 

*) 

(* 

Called  By: 

*) 

(* 

Main  Program 

*) 

(* 

Routines  Called: 

*) 

(* 

Procedure  Perform_Hatrix_Multiply 

*) 

(* 

Procedure  Prepare. input_block_for_FFT 

*) 

(* 

Procedure  FFT 

*) 

(* 

Variables: 

*) 

(* 

grad[j]:  gradient  sequence  for  current  block 

*) 

(* 

*) 

Procedure  Calculate_Gradient ; 


j : integer; 

Begin 

Perforin_Matrix_Multiply(XR,XI_conj ,ER,EI) ; 
isign:=-l;  (*  calc  inverse  *) 

Prepare_input_block_for_FFT;  (*  FFT  of  X_conj*E  *) 

FFT; 

For  j :=1  to  N  Do 

gradCj] ;=l/(2*N)*data[2*j-l] ;  (*  grad  =  1st  N  terms*) 
For  j:=N+l  to  2*N  Do  (*  of  inv  FFT  *) 

gradCj]  :=0; 
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End; 


(*  Procedure  Update_weights  *) 
(*  *) 
(*  This  procedure  updates  the  filters  complex  weights.  The  *) 
(*  new  weights  equal  the  old  weights  plus  the  product  of  the  *) 
(*  gain  constant  and  the  complex  gradient  vector.  The  *) 
(*  complex  gradient  vector  equals  the  FFT  of  the  gradient  *) 
(*  sequence  padded  with  N  zeros:  FFT[(grad  seq) ,  N  zeros].  *) 
(*  *) 
(*  Called  By:  *) 
(*  Main  Program  *) 
(*  Routines  Called:  *) 
(*  Procedure  Prepare_input_block_for_FFT  *) 
(*  Procedure  FFT  *) 
(*  Variables:  *) 
(*  HR[j]  :  real  part  of  complex  weight  vector  *) 
(.*  HI[j]  :  imaginary  part  of  complex  weight  vector  *) 


(  ^  !|i  It:  !|t  ^  >|c  4c  ^  ^  ’ll  =l<  4: 1):  ii  %  4:  it;  *  ^  ^  ^  If!  * ’ll  ^  >!< ) 


Procedure  Update.weights ; 

Var 

tap,j : integer; 

Begin 

For  j :=1  to  2*N  Do 

input_blockCj] :=grad[j] ; 
isign:=l; 

Prepare_input_block_for_FFT ; 

FFT; 

For  tap:=l  to  2*N  Do 
begin 

HR[tap] :=HR[tap]+mu*data[2*tap-l] ; 
HI [tap] :=HI [tap]+mu*data[2*tap] ; 
end; 


End ; 

(♦l|c4<*4c>l<**l|!*4:**=l'.>l'3|'J*4'*>l'’|:****l|t*I|'*>|ll|c*****i|'i|:i|'l|:*l|:*******i|t*******4:*) 

(*  Procedure  time_domain_wts  *) 

(*  *) 
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(  ^  t  ^  It:  ^  %  1):  %  It:  I):  stole  If:  4: 1);  I);  it:  It:  If:  :tci|c  >|c  If:  It:  If:  1):  ^  %  4c  *  ^  If:  If:  ^  ^  ^  ) 

Procedure  time_domain_wts ; 

Var 

j : integer; 

Begin 

For  j :=1  to  2*N  Do 
Begin 

V2R[j]:=HR[j]; 

V2I[j]:=HI[j]; 

(*  WriteLn(Lst,  ’  H(’,  j,’)=  ’,HR[j],’+i  ’,HI[j]);  *) 

End; 

i3ign:=-l; 

Prepare. input.block.f or.FFT ; 

FFT; 

(*  WriteLnCLst,  ’Block  ’ ,k) ;  *) 

For  j:=l  to  2*N  Do 
Begin 

WRCj]  :  =  (l/(2*N))*data[24:j-l]  ; 

WiCj] :  =  (l/(2*N))*dataC2*j]  ; 

End; 

End; 

(4<it:it:>t:>l<4!it<!f:4:!t:4:itc>t<>|:>t:it!’t:it:it:>t:>t:it<it:it:itc!t:>t<it!>l<4:>t!!tc>t:itc>l‘4:it:itcit:itc4:it‘>t:it:it:!f:it<)|<>t<>t:!t:it:>l‘4<>t:it<!t:>t:!t:>t:it:it:it:it!it:) 
(if:i|cif:itcif:itcif:!f:4:if:4:4:it<4c>|c!t:*>t<i|cit:>|:it:>t:>t:  Main  PrOgraiH  *  if:  **  if***#  ********  *11:  ******  ) 
(**************fc**************************************** **********) 


Begin 

Open_input_f iles ; 

Open_output_f iles ; 

Init.var; 

Load.input ; 

Load.desired; 

ClockOn;  (*  Turn  clock  on  *) 

Calc.numblocks; 
Calculate_avg_input_bin_pwr ; 
Calculate.mu; 

For  k:=0  to  Block_num-l  Do 
Begin 

WriteLn(  ’  processing  block’ ,  k) ; 
Past_current_block ; 

Diagonal_of_X; 

Calculate.y ; 

Calculate.error; 

Conjugate.X ; 
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Calculate_gradient ; 

Update_weights ; 
time_domain_wts ; 
end; 

(*  ClockOff;  *)  (^Display  elapsed  time*) 
(*  WriteLn;  *) 

(*  WriteC’Press  Enter...’):  *) 

(*  ReadLn;  *) 

{ ik  -t*  T  Tn<a  Wr>TT>o  n  r»  ^ 

Write .output; 

Close. input.files ; 

Close. output.files ; 

End. 
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F.4  TDF  Filter  Listing 


This  is  the  Turbo  Pascal  6.0  listing  of  the  TDF  program. 


Program  TDF; 

{$N+} 

Uses  Printer , CRT, DOS; 

CONST 

datasize=992; 

N=16; 

Misadjust=0. 1 ; 

TYPE 

Realarray=ARRAY[0. .datasize-1]  of  real; 

RealarrayN=ARRAY[0. .N-1]  of  real; 

VAR 

k: Integer; 
h,m,s ,slOO:Word; 

Mu , Px , StartClock , StopClock : Real ; 
errorf ile -outf ile , inf ile .desiredfile : Text ; 
error , desired , input , output : Real array ; 
weight .array : RealarrayN ; 

weightO , weight  1 , weight2 , weights ,weight4 .weights , weightC , weight? : text ; 


Initialize  Variables  *********^******it:********:ti****:if*) 

Procedure  Init.Var; 

Var 

j ; integer; 

Begin 

For  j;=0  to  datasize-1  Do 
Begin 

desiredCj] :=0.0; 
error Cj] :=0.0; 
input Cj] :=0.0; 
output [j] :=0.0; 

End; 

For  j:=0  to  N-1  Do 
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Weight_array [j] :=0; 


End; 

(♦♦**:(t*;(c*****)(t*j(!***j(c:t;***+  +  *:(c  +  **}(c**:(cj|<  **)*:*******************) 

Procedure  Open_input_f lies; 

Begin 

Assign(inf ile,  ’A;S53N.Dat’) ; 

Assign (desiredfile,  ’ArSS.Dat’); 

Reset (inf ile) ; 

Reset (desiredfile) ; 

End; 

Procedure  Open_output_f iles ; 

Begin 

Assign(errorf ile,  ’B:TFS3SNE.Dat’) ; 

Rewrite(errorfile) ; 

(*  Assign(outf ile,  'B:TFS4SNY.Dat’) ;  *) 

(*  Rewrite (outf ile) ;  *) 


End; 

Procedure  Close_input_f iles; 
Begin 

Close(inf ile) ; 
Close(desiredf ile) ; 

End; 

Procedure  Close_output_f iles; 
Begin 

Close(errorf ile) ; 

(*  Close(outf ile) ;  *) 


End; 

(*******♦***!(:**♦♦*****♦*♦♦*»♦*♦**♦**♦*♦**+*  +  +  ♦♦**♦♦*♦♦*♦♦♦*♦♦*♦) 
Procedure  Load.input; 

Var 

j : integer; 

Begin 

For  j:=0  to  datasize-l  Do 
ReadLn(infile,  input[j]); 

End; 

Procedure  Load.desired; 

Var 

j : integer ; 

Begin 
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For  j:=0  to  datasize-1  Do 

ReadLnCdesiredfile,  desired[j]); 

End; 

(^**^c**tt*********lt:*********.************.*******it^****7^***iti***i^*yt:*) 

Procedure  ClockOn; 

Begin 

GetTime(h,m,s,slOO) ; 

StartClock : = (h*3600) + (m*60) +s+ (slOO/ 100) ; 

End; 

(^*********:^***t*********>lf************************yt:*********ili:**7{f^:) 

Procedure  ClockOff; 

Begin 

GetTime(h,m,s,slOO) ; 

StopClock:=(h*3600)+(m*60)+s+(sl00/100) ; 

WriteLn(’ Elapsed  time  =  ’ , (StopClock-StartClock) :0:2) ; 

End; 

(^**^****:tt:¥*************ilflt:7t:lt:^:it:********l^*****J>c****iH:*****>iflt:>t:tlt:*A:!t:) 

Procedure  Write_output ; 

Var 

j : integer; 

Begin 

For  j:=0  to  datasize-1  Do 
Begin 

(*  WriteLnCoutf ile,  outputCj]);  ♦) 

WriteLnCerrorf ile,error[j] ) ; 

End; 

End; 

(**:^**^f**^*»:*****i*:^*:t::t**:t:it:iliitL^:iti^1i:t:****^***-***************m*****) 

Procedure  Calculate_mu; 

Var 

j : integer; 

Begin 

Px:=0; 

For  j:=0  to  datasize-l  Do 
Px:=Px+Sqr(input [j] )*(l/datasize) ; 
mu:=(l/N)*(l/Px)*Mis idjust; 

(♦  WriteLndst,  ’  mu=  mu);  *) 

(♦  WriteLndst,  ’  Signal  Power  =  ’  ,Px) ;  ») 

End; 


(♦♦*♦♦**♦*♦♦♦♦♦♦*♦*♦♦♦♦*♦♦♦**♦***♦♦♦**♦•♦♦**♦♦♦♦♦**♦♦♦*♦♦♦**) 

Procedure  Calculate.y; 

Var 

j : integer; 


sum.varireal; 

Label  End.loop; 

Begin 

suin_var:=0; 

For  j :=0  to  N-1  Do 
Begin 

If  (k-j<0)  Then  Goto  End.loop; 

sum.var : =sum_var+weight_array [ j] *input  [k- j ] ; 

End.loop: 

End; 

output  [k]  :=suin_var; 

End; 

( :f:  itc 4: Kc  :(c ’t' *  If  ^  ^  *  1):  ><:  t  ^  4  ^ ’ll *  *  ^  *  *  ^  *  4:  *  If:  *  ^  4:  ) 

Procedure  Calcuiate.error ; 

Begin 

error [k] :=desired[k] -output [k] ; 

End; 

*********************  ^:*******:^******  ********  **********) 
Procedure  Update.weights ; 

Var 

j: integer; 

Label  Skip.wt.update; 

Begin 

For  j :=0  to  N-1  Do 
Begin 

If  (k-j<0)  then  Goto  Skip_wt_update; 
weight_array[j] :=weight_array Cj]+ 

2*mu*errorCk]*inputCk-j] ; 

Skip_wt_update: 

End; 

End ; 

(*************************************************************** 
Procedure  Store.weights ; 

Var 

j : integer; 

Begin 

For  j:=0  to  N-1  Do 
Begin 

If  j=0  then 

WriteLn(Lst ,weight_array [ j] ) ; 

If  j=l  then 

WriteLnCLst ,weight_array  C j] ) ; 

If  j=2  then 

WriteLn(Lst,weight_array[j]) ; 

If  j=3  then 


WriteLn(Lst,weight_array[j]) ; 

If  j=4  then 

WriteLndst ,  weight  .array  [j]  )  ; 

If  j=5  then 

WriteLndst  ,ueight_array  [j]  )  ; 

If  j=6  then 

WriteLndst  ,weight_arrayCj] ) ; 

If  j=7  then 

WriteLn(Lst,weight_array[j]) ; 

End; 

End; 

(**************it;j(c*********=(c**********#J(c***>|t**ic*t*****  +  ********^****:(c*+) 

Main  PrOgraiH  ***♦*♦****♦♦:*:***  ) 

(*♦♦***  J(i*i(!**it!**  +  +  **i!<*:(t************<c***$***:(c*****************))t*******  +  :(t) 

Begin 

Open_input_f iles; 

Open_output_f iles ; 

Init.Var; 

Load. input; 

Load.desired; 

(*  ClockOn;  *) 

Calculate.mu; 

For  k:=0  to  datasize-l  Do 
Begin 

Calculate.y ; 

Calculate.error; 

Update.weights; 

(*  Store.ueights;  *) 

End; 

(*  Store.weights ;  *) 

(*  ClockOff;  ♦)  (♦Display  elapsed  time*) 

(♦  WriteLn;  *) 

(*  Write( ’Press  Enter. ;  ♦) 

(♦  ReadLn;  ♦) 

Write.output ; 

Close.input. files; 

Close.output.files; 


F-=)l 


End. 
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